I think its ruder to express an opinion of someone elses children having had no experience yourself.
Having said that though, im careful not to use the 'but your not a parent' card when I hear something I don't like/don't agree with. Just because I think someone else has been rude it doesn't mean I need to be as well.