also depends on where you are. i have some that have been sitting in my dining room for a month because i thought i'd get more earler and do it all at once. then the rains came....
if you are in a place where you are going to have a bug problem, you might not want to do that. you can freeze, but as pointed out, you need to get them good and warm again before extracting. freezing also kills the critters that might be on the frames.
i am lucky to have very little wax moth and no hive beetle. i only need to worry about ants and so far they are not in my dining room :-)