I can't pump either. It's more common than you might think.

You'll probably find that he will take in more fluids and solids when you're not around, as long as it's being offered. My DD2's food intake increases dramatically any time she has a longer break. That didn't start until about 9 months though, so unsure how it would go with a younger kid. You could always try, with spoon feeding as a backup?