As long as he is getting fluids into him he should be OK. You will know if he is getting enough by the wetness of his nappies. Your breast milk has plenty of goodness in it to help him over the bug. Give him tiny amounts if he wants them but don't be too concerned if he is not that hungry.
I know after I have had a tummy upset it can take a while to like food again.