Ellison Bay is an unincorporated community and census-designated place in northern Door County, Wisconsin, United States, within the town of Liberty Grove and is located on Highway 42 along the Green Bay. As of the 2020 census, its population is 249. Sur La Baie, one of Wisconsin's largest and most expensive homes, is located nearby.