AJ, if you just switch to low-GI carbs then you don't need to cut them out at all. Potatoes are VERY high GI, just like eating a bag of lollies in terms of sugars heading into the blood. Sweet potato is very low GI (and IMHO tastes MUCH nicer, so sweet!).

Oh, and another tip - just swithing to brown bread does not necessarily help you, it needs to be a really grainy bread, otherwise you might as well stick with white bread...a good compromise would be to go to white grainy bread??