I would tell them you wanted something done as by now there should be some sort of improvement. Tell them what that guy said and say you never want to be refered to him again. We go to the specialist to get extra help, not to be fobbed off.

Also ask if there is anything you can do to draw out the infection