Hmm, You know best by looking at his cues and what he is doing...

My suggestion would be to feed him for twenty mins then arouse him (Change his nappy, take some clothes off) and then place him on the other side. and get him to feed again.

He could just be being fuzzy and want to feed more times

(I gotta go - BBL if I think of anything else)