You would have a lot more walking in St Martins if you want to get out to the sea caves and it will be ocean floor. So it will be wet, possibly muddy. You also need to make sure you go at low tide.
Peggy's Cove is pretty compact when you compare the two.