Good idea, but the arrow would be kinda obnoxious.
Maybe instead, something like this?

Maybe a tab on the bottom, with an arrow that moves kinda like a compass? it would give a use for the #u, #d, #l, #r arrows.
And a target that hides the tab once you no longer need it