That statement is just way to broad for you to take much notice of. It all depends on the situation.
I think some people think that one will be the odd one out - but that doesn't apply to me - mine are really spread out. It doesn't apply to my GF with 3 either and hers are closer together.
Start telling them you are going for 5 and see what the reaction will be then