I had my IVF transfer when I had a cold a few weeks back and got a BFP (yet to be confirmed by BT). Another person also had a similar experience. One of my friends IRL had the flu when she fell. So, I think you've got just as much a chance as any other cycle. I do understand why you might think the chances are reduced, as I thought the same.