After visiting the caves, walk two blocks to the Swizzle Inn for lunch, get conch fritters and a pitcher of rum swizzles. From there, take the bus to the museum/aquarium. Then take the bus to Hamilton and the ferry back to the dockyard. Buy the transportation pass in advance and your total transportation will be about $15 for the day. There's a lot going on but you'll thoroughly enjoy yourself for a reasonable price.