Restricting a main gameplay point like this would only further kill the game.
No arrows or bombs in a tower kills the lighthearted moments we've all had.