As far as I'm aware it can cause problems all the way through pregnancy, from what I've read pregnant women are 20 times more susceptible to listeriosis than anyone else. If you do contract it though, you can have antibitotics which will go through the placenta to the baby.