So, he's awake and alert at least some of the time? If so then he doesn't sound like he's weak with hunger.
When they're little a big poo can certainly affect weight gains. Where is he at now, compared to birth? If he's gaining weight on the whole, then that's a good sign.
Is he growing - length & HC?