Carlton is a city in Madison County, Georgia, United States. The population was 263 at the 2020 census.