The further you go out, without an exact bearing and navigational devise, the chances of finding it would be slim. Even if you start out just a few degrees off course, by the time you get miles and miles out, you could be miles and miles off course, and would never see the boat. More than that, though, there seems to be some weird thing with the island in terms of how you can get in, and how you can get out. Just think of getting through that forest in the original NES Zelda game.