I clean inside that middle 'stem' section probably once every 2 months. Take the whole thing apart once a year. If you dont stay on top ofit it can make the clothes yucky.

ETA- I just clean it with warm soapy water and one of those sponges that are yellow on one side and soft and green and scoury on the other side.