I'd say it is the b/f that is upsetting things. I think prolactin suppresses ovulation. Even if you start getting AF again, high levels of prolactin can stop conception.

Hope that helps a bit.

Lisa