It happens to me too. And I usually forget about what happens when I do moisturise, only to remember when I feel like all gross & sweaty later in the day/evening... and of course it is usually when I am talking to someone.