Could you try trimming your kittys rear end fur? This could limit the amount of time that you would need to spend cleaning her rear...?
Otherwise, as long as you wash your hands thoroughly and keep them away from your mouth until clean then you should be okay. My Dh is currently on tray duty but occasionally gets a bit forgetful so I go in and tidy it up for our cat. I just be extra cautious with it, as well as trying not to do it too often.