Castle Gardens gets its name from the outcropping of sandstone that the wind has eroded into fanciful shapes resembling the turrets and towers of castles. This unusual formation has been luring visitors for thousands of years, and many of them left their mark in the soft sandstone.