After everything you have been through the last thing you need is unsupportive people around you. Hopefully you can sort it out with the specialist so that you can do what is right for you and the girls.