We have 5 cats and both me and my DD's are fine. DH used to do the cat litter and still does. Our cats never really went near the girls...maybe sniff them and then walked away. My DD1 chaes them around now she can walk...but they live outside in an enclosure 95% of the time so rarely come in contact with them.

I personally wouldnt get rid of my cats when TTC and UTD....its all about good hygene and watching ur cat!