That's exactly what I reckon. It just doesn't make sense. The doc might be the one with the medical degree, but I'm thinking she's off the mark with this.
Time to get a new gyno or go to a FS if we don't get our BFP soon.