Do you like cliff jumping?
If yes, you should definitely visit Ammoudi Bay and jump from the rocks inside the Caldera. Here people are sunbathing on the rocks and jumping in the sea when they need to get cooled down. It is even possible to swim and climb the small rock with Agios Nikolaos church. This spot is a bit hidden and you need to know it. From Ammoudi Bay you have to walk left along the cliff side on the rocks and continue straight ahead.