I'd guess that as well. The old queen for some reason didn't join them. You may want to look to see why they swarmed. Africanized hives will do it this early in warm areas at times. I'd check for mites, ants or something that's bothering them as well. If don't see drones hatching in any of your hives, I'd vote for something bothering them.