I've also been advised against taking them when on the IVF meds. Perhaps ask your FS and see what they advise.
Wishing you the best for your cycle.