I used a punt to cross a river by zooming out, traveling one tile, and then zooming in. I then ended up far up on land (while still on a river tile), presumably because I've gone there during the winter, and thus have zoomed out from the water. The tile is a river bend tile and my location is some 5 tiles diagonally from the river course changing point (on the "outside" of the "knee").
There's a need for a check that the stored zoomed in location is valid for the traveling mode, and use the default one if it isn't.
This is a minor inconvenience as I'm using a punt, but I wouldn't like that to happen with a raft loaded up with logs...