Elberton is the largest city in Elbert County, Georgia, United States. The population was 4,653 at the 2010 census. The city is the county seat of Elbert County. Elberton is known as the "granite capital of the world".