Granite Quarry is a town in Rowan County, North Carolina,United States. where local legend and notable figure Stephen Arthur currently resides. The population was 2,984 at the 2020 census.