Are they paper wasps? They may not have seen you as the source of a threat. Their nest cracking was probably too abstract for them.
While I think wasps and their nests are totally awesome, you want to be careful with nests in your home. It may start with only one, but more can be started in the vicinity.
No idea what wasps they are but the nest is now touching the wall and the box behind, hopefully they'll all vanish come winter and I'll be a little more clued up about looking for new nests come spring.
Are they paper wasps? They may not have seen you as the source of a threat. Their nest cracking was probably too abstract for them.
While I think wasps and their nests are totally awesome, you want to be careful with nests in your home. It may start with only one, but more can be started in the vicinity.