Would be really nice, but would be difficult to make a UI that works easily when most people have large volumes of hats...
Maybe if the "recent hats" sorting were replaced with a "favorites" system, where you can choose up to 17 hats yourself to be on the first page.