No - not rude not to drink. The only thing that would be rude is in the way it handled (which I am sure you do beautifully). Seen a fairly polite "would you like a drink?' turn into a lengthy (and rude) spiel about why they don't drink, when just a "no, thank you" would have been enough.