If you are on a budget, hostels are your best option. Even though Icelandic hostels are still a lot more expensive than hostels in other countries...

The one is Höfn is quite nice. It is very basic, but if you just need a bed for the night, it is perfect.