You can just swim east from the third Shrine's location if you're already there ... Depths is located on the steep hills north of the New Fontaine Research Institute. You can climb the stairs ...