One of the other guys with SBB's on his hives had the same problem. I had him make a 3/4" x 3/8" opening to encourage the bees to go inside. I didn't hear anything back from him, so since I have talked to him since, I would assume that cured the problem.
I now recommend an opening there for the virgin queen to get back in the hive.
I also recommend robber screens be left on anytine there is a possibilty of robbing happening. I have seen where full scale robbing affects all the hives. With the screens, it's a win/win situation, without, you might be ok. To me there isn't a downside as long as you make the opening for the queen and, in this case, to keep them off the SBB.
One of the bee supply houses used to sell these screens as "Moving Screens" if you want to buy them.