If your dr isn't listening to you, i would look for another one. Do you have a good GP you can ask if they know someone else? Do you have mates who see a FS that they recommend?

You shouldn't have to start all over again, because any test results that your current FS has, you can take to another FS. If you can start asking for copies of any tests, it is always good to have your own file anyway.

Did the FS say why he wanted to try Chlomid rather than surgery? Knowing the reasons for his decisions might make you feel better about the decision (if you agree)

good luck matey.