first you have to determin the cause, the cause of your hives dying out! only then should you consider using what's left of the hive: honey comb, comb...
since you're a newbie this might be difficult, and since i'm a newbie aswell, it will be hard for me do describe different symptoms from which you should judge the cause, if there are any experienced keepers around, try to get in touch, ASAP.
well, if they died out of starvation or cold, it's ok to use the combs, if it's disease.....
anyway, let's just wait, what more experienced ones have to say.