I would keep the cat - just be really careful to wash your hands thoroughly after you touch her and take extra precaution if you change her tray (or better still have someone else do that for you).

I can understand why you were upset about what your doctor said. Some people don't understand that pets are part of the family not just 'animals'.

Good luck with ttc.