It depends on what you are making. If you are making something you want to keep for a long time, I do agree with briggsy's girl.

However if you are making cards, or experimenting with cutting things out or colours, there's lots of cheaper items around. Bargain shops, Big W, have a not too bad range. Spotlight have some supplies.

Online there's a site called Blue Edge crafts or something, that's the cheapest one I found.