How does groundwater create caverns? Caverns are created when acidic groundwater dissolves and carries away limestone over time. Caverns are created when pure groundwater dissolves and carries away limestone over time. Caverns are created when acidic groundwater dissolves and carries away grains from sandstone, shale, and other rocks over time. Caverns are created when pure groundwater dissolves and carries away grains from sandstone, shale, and other rocks over time. Caverns are created when moving groundwater mechanically weathers sediment and transports it elsewhere, leaving behind large empty spaces.