Milton is a town in Caswell County, North Carolina, United States. The population was 166 at the 2010 census. It is adjacent to the Virginia International Raceway, just across the state line in Virginia. The town's name was derived from its beginnings as Mill Town. A mill was established prior to the incorporation of the town.