If it were me, I wouldn't take them to the Dr, if he's already run down you dont want to be sitting in a waiting room full of sick people and have him catch something worse. he doesn't seem like hes all that sick kwim and if he's coping well enough with panadol and mummy love then he should be fine