Did you weigh him with the same scales everytime - there can be a variation between scales at different places especially if they dont calibrate them often. I'd agree with trying to offer a few more feeds in the day - if he doesn't want more milk he'll let you know.