Dee, it won't do any harm hun. You will still produce enough for your baby when the time comes. Someone else posted about this a while ago, so your DH is obviously not the only one!