You'd have to do that manually, and for people who want their house open publicly, but don't want specific people inside then you have no way to stop them.

An example would be is if you have a riddle in your house to figure out, but a guild member of yours keeps entering your house to tell everyone the answer, how would you filter them out? You can't block them, they are a guild member you still have to communicate with them. If you make your house friends only you make it where not everyone can enter your house.