Columbus' first known settler, Elbert Dickason, built a home and sawmill on the west side of the Crawfish River in 1839. Many others of German, Welch, Scandinavian and Irish came after. The family names of these early community leaders live on as major street names in the city. Columbus incorporated as a village in 1864.

James T. Lewis, governor of the State of Wisconsin, 1864-1865, was an early settler, and Columbus' first attorney. The "old War Governor," as he was fondly known, was also a signer of the Wisconsin constitution. Columbus became a City in 1874.

A number of different buildings played roles in housing the various functions of local Government in the period before the present City Hall Building was constructed in 1892. Many of these buildings are now included in the Columbus Downtown Historic District. Columbus City Hall still serves the community's governmental needs. Renovation work, done primarily by volunteers, included restoring interior woodwork, renovating the exterior, and repairing the clock tower.

Architecture is the primary "tourist" attraction Columbus offers the casual traveler or seasoned student of design. The city is noted for its elegant nineteenth-century homes and buildings. The community strives to preserve and promote this particular heritage. Jaeger's Mill, built over 100 years ago, is an artist's and photographer's dream. It is located on the Crawfish River four miles east of town beside the dam, which powered its operation for many years.

Columbus' entire downtown commercial district is on the National Register of Historic Places. Each historic commercial building lends its special character and charm to the Columbus downtown. Columbus is a Wisconsin Main Street Community.

The Columbus Main Street Historic District was listed on the National Register and State Register of Historic Places by the U.S. Secretary of the Interior on March 5, 1992. This area comprises the original center of the City, from Water Street to Dickason Boulevard, from Harrison Street to Mill Street. A second area along Prairie Street is included as of January 7, 1999. This residential street includes a variety of housing styles and buildings important to the history of the City of Columbus. A third historic district was created on March 4, 1999 to include residential and commercial buildings on South Dickason Boulevard. This district includes a significant roadway section and many original home site for the city.