I'm no PCOS expert but I've been investigated for it twice (ten years apart) and been found not to have it even though I had several of the symptoms including the weight gain around the middle, the hair growth, infertility, acne (the first time round, not this time) but not polycystic ovaries. It doesn't sound like you have the symptoms so I wouldn't worry too much about it. Unfortunately many doctors see PCOS as the most likely reason that you aren't conceiving and launch into testing for that before testing for anything else.

Sometimes things just take time. My first pregnancy took 3 years to achieve and I was seeing a FS at the time. Clomid didn't work for me but I did get pregnant 3 months after going off it. My second pg took 9 months to achieve and the 3rd took 4 months. All these pregnancies miscarried early. This pregnancy was achieved after being told my only hope was IVF (due to my infertility history, my age 41 & my m/c history), but here I am 16 weeks tomorrow with a naturally conceived baby. You just never know what's ahead of you on your TTC journey.

Don't be scared of FS's but also don't expect them to have all the answers as they can be wrong.