Norway has two "houses". One is a rather small and nondescript apartment in Oslo. But his main residence is actually about 1/1.5 hours away from the capital, just outside a small village. It's a large, old house that he's had for quite a while. Not the same as the one we're shown in the comics - that house is probably long gone, considering the state it was in - but it might be in the same location, which wasn't specified.

Iceland's house is small, newish (at least in comparison to Norway's main home), and very light and cheery inside (lots of white, lots of natural lighting). He doesn't really have a lot of personal possessions, so the main areas are very neat and tidy. ... His bedroom, though, is another story.