Galle has great history and some beautiful places nearby to visit but the area inside the fort is quite expensive by Sri Lankan standards. You can always stay nearby at a small beach town and drive in to visit the famous fort