Guess it depends on whether you will beat yourself up if it doesn't work and blame yourself? Women get preg all the time and carry on as normal so I assume things can work fine - but I'd be scared that I (personally) would blame me too much.
But hopefully it's a BFP so it's not an issue at all