I haven't owned a cat since having children, but I wouldn't trust any animal unattended around my child.

But friends of ours put a screen door on the baby's room. That way, air still circulated, they could hear and see bub, but the cat couldn't get in.