This was just my have direct access to second loo thinking. But in that rare occasion you can probably just go downstairs.
In any case, one less bathroom but more place for stuff (unless you have a minimalist wardrobe) seems a good option seeing as you have all the bathrooms anyway.
I'd so have a walk in wardrobe with that many loos.
Maybe make direct acces to the other loo on same floor possible.