Big box stores are an easy idea when it comes to the chemicals, but dont forget about the small hardware store's and co-ops in your area. Prices may be slightly higher than expected, but it will get you started until you find a cheaper source.
The muratic acid I found in Wisconsin comes from Fleet Farm and Menards. At both places it is found in the paint section.
Cheap hydrogen peroxide can be found in the health care section of any department store at about $1 per bottle (+/-). Yes this is the dilute stuff, but it works great with a small fish tank aerator pumping air to keep the agitation going.
Sulfuric acid - Rooto brand was found at my local Ace hardware. Hey Ace is the Place for sulfuric. Yes you can also get diluted sulfuric from any auto parts store and boil it down.
SMB - Sodium Metabisulfite. Ive gotten the product of White Out from the laundry aisle from my local grocery store. So far it looks like a great precipitant. Other SMB substitutes would be SO2 gas, sodium sufite (photo processing agent) Potassium meta bisulfite used in wine making could be found if you have a local wine and beer making shop.
Copper Mesh Screen for the cell - I found this at an arts and crafts store near the frames for artwork. It was in an odd spot, but if you look you can find it. The stuff I got was about $15 and was a fine weave so no pins could slip though.
Lead for the cell - Go to your out door recreation supplier and head for the guns area. I picked up a 5# box of 50 cal muzzle loader shot for about $7. Melt what you need, store or sell the rest.
Sodium Nitrate - go to your devoted lawn and garden store. They will have it at sodium nitrate or nitrate of soda. a substitute would be Blood Meal. In either case you are looking for something with a big first # and 0-0 for the other two. Sodium nitrate is 16-0-0 and blood meal is 12-0-0.
Buckets - this is my favorite because they can be FREE! I am able to get them from my local grocery store that has a full bakery inside. These buckets hold glazes and such. Its best to go in the late afternoon or early evening. My place says take as many as you want, otherwise we throw them in the garbage.
Your local stores may not have everything, but keep searching. Also if you take a vacation or just a road trip, stop in any hardware stores you find, you may get your stuff that way too.