Hi & welcome to BB!
I didn't forget many pills (and the couple of times I did/got sick in the tummy we used alternative contraception) so I am confident that we were protected throughout the years I was taking it.
Having said that, I certainly found that around the third cycle of TTC I had very similar feelings to you. Was there something wrong?? (Especially since we'd been having more sex than we ever had before and I was pretty confident about my ovulation times). We were fortunate enough to conceive shortly afterwards. I think it's really hard to avoid those feelings, and after experiencing them I can come close to appreciating how much these feelings must be amplified for LTTTCers. Hang in there and keep positive! A beautiful healthy pregnancy could be right around the corner All the best.