As far as I can see, the only notional advantage gained from being based just offshore is that they can theoretically leave, though that does seem to be (i) vastly underestimating the complications involved in sailing to whichever other country will have them and (ii) vastly overestimating the difficulty of selling up and leaving under a more regular land-based arrangement.
They could theoretically leave, but if they have serious unresolved disputes with their host country, it could very well prevent them from leaving by using force. What then?