I got a bunch of free 5 gallon buckets for maple syrup collection this year. I went to Meiers, Walmart, etc, and got the icing buckets...BUT I then spent hours cleaning them, over and over, and soaking them overnight, trying to get the icing smell out, which can potentially change the taste of the syrup or honey, depending on contact time. I risked it with the maple syrup (which went buddy on me so it didn't matter anyway).
Don't even think about using pickle buckets, I hear they really absorb smell from acidity. I went to several restaurants and that's all they had.
I hear that Tractor Supply has the 5 gallon buckets with lids for $2 right now. That's a good price, and a much better use of time than cleaning buckets. You can buy plastic liners for the buckets. Home Depot and Lowes also have the buckets.
Be aware that those dang buckets disappear into thin air. Yesterday I found one of the wiley guys, full of used tractor oil. :-P