BW,
It would be best if you went to a FS who is also a Reproductive Endocrinologist. They usually have CREI after their name I think. It is an overseas qualification I believe and they have studied the endocrine issues that can affect fertility and PCOS is one of those. To find my FS, although I was not sure that I was going down the IVF path, I went to the websites of the 2 IVF places in Melbourne and they have the doctors profiles on them and I picked the one that had the qualifications and interests that most matched what I needed.
good luck. sounds like a change of doctor is just what you need.