I found that up to 2 children - people expect you to go back to work. But when you have 3 kids, nobody asks you at all what you do, or if you stay at home...

So there's your answer - have more kids! lol