cochineal = pink
turmeric = yellow
cocoa = brown (haha obviously)

These are the only ones I know, but you can get them at your regular supermarket.

Oh, just remembered - sometimes ppl use beetroot for pink colouring but I'm pretty sure you'd get a bit of beety taste with it.