Caroga Lake is an unincorporated community and census-designated place in the town of Caroga, Fulton County, New York, United States. The population was 518 at the 2010 census. The hamlet is in the southern part of the town of Caroga and is northwest of Gloversville. Two lakes, West Caroga Lake and East Caroga Lake are located next to the hamlet.