Could he maybe be getting a cold? He might be finding it tough to breathe through his nose if he's getting a little cold. Or maybe just out of sorts. Hopefully things turn up again for you and he's back on the boob soon.