If you want to see the glacier from up close, you can do a boat tour on the lagoon.

The benefit of doing a tour in Fjallsárlón is that it is quite a small lagoon and therefore you can get to the side of the glacier quicker than on Jökulsárlón.