My father just bought a tank from bunnings, stuck it under the downpipe and fills his jug for drinking water. It's not even very big but it's all he needs.
You can get rebates etc for buying a tank but you will find you are charged for storing your own water (ffs, I'm not even going there) so it's best to avoid the rebate.