I was going to say the same as Lady Neon. There is no perfect time. There is always something presenting a hurdle. I dealt with it by having contingency plans in place. But sometimes **** just happens.

Maybe it's time to have an open discussion with DH? His comment makes it sound like he is ready to talk. Even of it is just to put a firm plan in place about TTC.

Many hugs for you during this difficult time.