I really don't think it should behave that way. While possible with commands, it's hard for normal players to get to the nether, for example. Also, I wanted to look at loot chests which was only possible by spamming F3+N and right mouse button.