I don't think it's rude, but I will confess it bugs me if I'm talking to someone and can't see their eyes.