Sudurbaejarlaug in Hafnarfjörður has an outdoor pool, hot tubs, a waterslide, fountain and indoor pool for the kids. There is also a gym in the same building.