I don't really think people mean to be rude. They are often just surprised and it's the first thing that pops into their head. People said it to me a lot too, but water off a ducks back i say!