Colfax is a city in Richland County, North Dakota, United States. The population was 172 at the 2020 census. Colfax was founded in 1881. It is part of the Wahpeton, ND–MN Micropolitan Statistical Area. In the mid-1960s it billed itself as the "smallest town in the U.S. with a public swimming pool".