Brass Castle is an unincorporated community and census-designated place located within Washington Township, in Warren County, in the U.S. state of New Jersey. As of the 2010 United States Census, the CDP's population was 1,555. Brass Castle is named for Jacob Brass, an early settler of the area.