Is this because you need them in the other place or because you don't want them to drift? If you're moving because you don't want them to drift, do it immediately... or not at all and shake in some extra bees. If you're moving because you want them in the new location, then I'd do it immediately, again, to prevent drifting.