I would go & see another tr dr, or is he the only one for the public system?
he has no right to deny you because he "thinks" you have enough children.
Can you complain to someone? Gosh it just doesn't sound right.