Custer County is a county located in the U.S. state of Colorado. As of the 2020 census, the population was 4,704. The county seat is Westcliffe.