For the last several years we've had a beehive in a crack in the stucco exterior of our house. Most of the year I'm only somewhat aware that there are thousands of bees living in my walls, but this time of the year they swarm, presumably because they have an extra queen in the hive. I know when they're swarming because I'll find bees flying in the bedroom...
I leave the hive alone. I need pollinators and love bees. My garden is always full of them, and I never mind them when they sting me in the garden, regretting only the misunderstanding has to end in the bee's demise.