I am so glad Sue that he has already referred you on. Once you have been thoroughly 'checked out' then you will know what needs to happen next. Maybe it will be a fertility specialist or maybe it won't. Try to take each foot in front of the other and not jump to conclusions until you have all the information. I am so relieved your gp is caring and empathetic. When you have a care provider that treats you with kindness and respect the road is a little easier to travel.
Know that I am thinking of you.
Hugs