I would move on. I had a very bad experience due to sticking with a group that became unwelcoming (it started OK, but a new member turned it sour).
After that I decided that any group that I did not feel OK at, that I would move on. I found when I moved, that it was helped. I gave groups ago, a couple worked well for a long time and there were a couple of others that I got the vibe very quick wouldn't work.

I also found the girls were more settled at groups that I felt more comfortable at. So it was a positive for them to.

I know how much this type of situation can suck.