We are thinking the same thing. I found a company in Palaiokastritsa that will do a 1.5 hour guided boat tour of the beaches and caves. However, we don't know how to get there! Is it easy to acquire a taxi and the pier? Or do we have to arrange it ahead of time?