I think they'll only say something if they are worried you are putting on too much weight too quickly in pregnancy for the babies sake

if you go in there at a certain weight they can only expect that you'll put on more, I had the opposite problem, they were complaining I was unhealthy for not putting enough on last time

Best of Luck and I'd definately stand up for yourself if they say anything