Caswell County is a county in the U.S. state of North Carolina. It is located in the Piedmont Triad region of the state. At the 2020 census, the population was 22,736. Its county seat is Yanceyville. Partially bordering the state of Virginia, the county was formed from Orange County in 1777 and named for Richard Caswell, the first governor of North Carolina. Other Caswell County communities include Blanch, Casville, Leasburg, Milton, Pelham, Prospect Hill, Providence, and Semora.