I found an position where you could just walk (no crouching needed) out of bounds. It’s a pretty big hole in the south of the cave, as seen in the screenshots. I think I have seen another spot already, so I would suggest you to check the caves for additional holes.
PS: The Combat Drillship in the cave caused some problems, but I survived.