I think that you need to follow the Doctors verbal advice. If you don't see an improvement in 48 hours take her back.
The rest of it - feeling like you're being paranoid may be his opinion or may just be something that you are projecting onto him. Either way it irrelevant.