Kyststi (Coastal walk) starts from the very end of Frognerkilen, and takes you along the water edge for about 1-2k. You cross past Oscarhall, which is owned by the royal family. It also offers nice views of Oslo, and you end up close to the museums on Bygdøy. Stop at Oscarhall for a coffee and a tour if you're here in the summer.