Laugarfell hot spring is a super nice one next to the Laugarfell hut. They have changing rooms and showers and charge a small fee for using the pools.

You can also camp here for the night.