This you have to get used to.

In the same day I've had one person tell me how tiny I was, the next told me it looked like I was having TWINS. Der
Me too I think sometimes people comment just for the sake of commenting!
If all your checks with the doc/midwife/scans have been fine I wouldn't worry.