A big hug for you Tunz.
You are obviously a good friend - you have maintained these relationships even when you are hurting very deeply. Maybe these people aren't aware of how much their comments hurt - or maybe they are a bit insensitive, having never experienced your TTC situation.
I could be all sensible and tell you to talk to them and ask them for some support and a bit of understanding and kindness. But honestly, during my TTC journey there were times when I felt I needed to cut myself off from certain situations and people too. It's just sometimes easier and less painful for you.
Don't write these people off altogether though! Just chose the right time to be around them, and be selfish of your own emotions and feelings. If you think you are a bit sensitive and might get hurt, then protect yourself from it.
TTC is emotionally very tough for most people.
There is a TTC vent section (TTC Vent) if you would like to make use of it as well. It can help to just vent sometimes and not always look for solutions.
I wish you all the best with your journey,
Jo