I think folate is the only 'must' but even then.. some people don't realise they're pregnant until a few months in, and others can't keep a thing down during that first trimester, so it obviously isn't an absolute must.

I'm hopeless at taking tablets, so I usually stopped taking them once through that first trimester. And I've never taken them breastfeeding either. You only need them if your diet is lacking.