Fort Chiswell is a census-designated place in Wythe County, Virginia, United States. The population was 939 at the 2010 census. Fort Chiswell is located at the junction of Interstates 77 and 81. Going west from Fort Chiswell, drivers find themselves on a double wrong-way concurrency- one of few in the nation.