Yep! They tend to get "antsy" when they can't get in and out. I once asked on this forum what the heck "this sound" was. I don't have the recording anymore, but it sounded like bacon frying. Someone suggested they may be chewing, which it turned out to be.
I set a swarm trap, and couldn't get back to it for about a month. When I got to it, the bees had absconded, leaving combs that had been eaten by something, no real trash or frass inside, and they had drilled a single "bee sized" hole just over the entrance. Even today, when I get bees in it, they go through that little hole.