I haven't read all the replies so I apologise if I am repeating anyone

When my DS was born, one of our cats (we have 2) peed in our bed and one of them (or both) kept pooping where his toys were. It doesn't happen much now but occasionally we'll find a poop in DS' room.

And like you said, they had clean litter boxes all the time!