No, I wouldn't believe that if I were told that. I ate a lot of junk when I was pregnant with DD, and she was 2.8 kilos!
The baby is as big as it is according to its genetics etc, nothing to do with diet.