I would ease off the solids a bit - make sure you are offering the breast first, and don't offer the solids immediately after he pulls off.. If he isn't draining the breast effectively at any feed, I would focus on that.
Is he being otherwise distracted from the feed? TV, other kids, etc?