Use "unstuck me" to get back to the castle faster, and unless you drop the bounty box you can't use the warp ring.