Columbia County is a county located in the U.S. state of Wisconsin. As of the 2020 census, the population was 58,490. Its county seat and largest city is Portage. The county was created in 1846 as part of Wisconsin Territory. Columbia County is part of the Madison, WI Metropolitan Statistical Area as well as the Madison-Janesville-Beloit, WI Combined Statistical Area.