A lot is just down to genetics.
GD can affect birthweight but not all mums of big babies had GD ( mine were both over 4.5kilos)
Your baby will take what they need from you. You could always see a dietician if you want to.