Sag Harbor is an incorporated village in Suffolk County, New York, United States, in the towns of Southampton and East Hampton on eastern Long Island. The village developed as a working port on Gardiners Bay. The population was 2,772 at the 2020 census. The entire business district is listed as the historic Sag Harbor Village District on the National Register of Historic Places.