Irvington is a town on the Rappahannock River in Lancaster County, Virginia, United States. The population was 474 at the 2020 census. Located on a peninsula known as the Northern Neck, it has been designated a historic district.