We are in a similar boat. DH works away and other then BB I have no one to talk to about it but its always on my mind and when DH is home thats all we talk about and thats very draining. It really does help to talk about other things for us in times when that is the main topic of conversation and we try and go for weeks at a time without talking about it in any great depth. I think coming into starting IVF its a very anxious time so you can't help but talk about it. I also start soon.
I don't really have any advise except your not alone.