I notice it more if i'm wearing something that is fitted... although going to a wedding a couple of weeks ago and not being able to wear my favourite little black dress because I couldn't do it up was a bit of a realisation too!!
I tend to forget if i'm in my work shirt though because it is soo big and covers and bump