I have to clean my brush twice every time I use it LOL. Think of it this way....there's less to dry.
It's a pain I know but the worst bit is the vaccuuming I reckon.