Clayton is a city in Rabun County, Georgia, United States. The population was 2,019 at the 2000 census. The city is the county seat of Rabun County and is located in the Blue Ridge Mountains.