It sounds more likely that the winning sperm got there on Day 13 but I would just be guessing. It's true that condoms break but seeing as you used the withdrawal method on day 13, it just seems more likely that this is when it occurred.

Have you observed your fertile signs using your mucus? The Billings method of mucus observation is pretty spot on and very useful if you are trying to conceive or avoid conception.