We have made the switch and as a PP mentioned it is easier if you have the time to take it slowly and bit by bit.

It does cost more for some basics (namely milk), but if you start hunting down your local health food shops you will find that bread can be really competitive (and freshly baked that day!). you'll never beat the $1 white bread loaves at the supermarkets...but i figure that's AOK

We took our time doing a full conversion simply due to $$ i needed it to not be restrictive. so, for example, everytime i found biodynamic/organic free range eggs at a good price i would take note of where i got them and what the name of the farm was.

we order our fruit and vege online from an organic farm group. it works out to be super competitive with the supermarkets. and i supplement if i need to at the local grocer (for example our apples this week were so DELICIOUS that we ran out on day 3 ).

Organic meat can also be bought online and that is our next step (so we are nominally vegetarian right now lol). they tend to do bulk lots but there are some that do smaller packages. the bonus is that they all deliver too!

we have loved doing the conversion. food tastes like it should ITMS. milk is so creamy and yellow (we buy full fat...) soooo yummy!

i found organic sweets etc to be expensive (except chocolate...that's competitive), so for biscuits i am getting all martha stewart and making them from scratch with my organic ingredients. and nothing fancy either...short bread, jam drops etc. i am not a baker lol.