I use the Fowlers Vacola kit. Got it from DH's Nan (it was hers from their farming days) I get the lids, rings, clips etc from Mitre 10. Supplies can be bought online, but for this I prefer to support a local business, so then it means there might be items in stock when I need them (I believe it is Fowlers philosophy as well). Have not had to buy bottles, as many came with the kit, plus some people pass on theirs when they know you use them.

For basics, like jams, relishs etc, I just use normal glass jars with the lids with the pop centres. You can get 3 uses out of those lids and you can purchase more online to match your jar sizes.