If the blood test has shown that your hormone levels are low enough, it should still be ok to start. The fun thing about irregular periods... it's possible that your hormone profile on whatever day matches the hormone profile of someone on days 3-5. Call the clinic for reassurance but it isn't necessarily wrong.

BW