Your doc's opinion sounds very extreme! As all the others have said, the nly real risk is being exposed to their faeces, so as long as your partner changes the litter and washes his hands before coming near you it's ok. As for cats and babies, we just always made sure the babies door was shut when he was asleep, but our cat didn't like him much till he was about 1 yr old anyway so I'm sure she wouldn't have wanted to go near him!

Cats are part of your family too, so there's no way I'd get rid of our beautiful girl just based on what one (possibly prejudiced) doctor has said!