Are you breastfeeding, because that's supposed to be really good for cleaning the mouth too.
DS was the same and I didn't really stress about it till after he'd weaned. We are finally at the point now where he will let me brush his teeth (more or less).
If DS does his own he sucks the brush, swishes it around his mouth and makes brushing sound effects.