I don't think you should worry about saying it nicely, if they are rude enough to say something like that to you! I mean, they were first time mum's once too!