At that age, making new friends is a very quick process. So I wouldn't worry from that PoV.

But I'd be more concerned about how it would affect going to school afterwards.

The other thing is, if the bullies' parents are doing nothing about the bullying (and yes, it can be classsed as such) then I'd move to a school were there were more concerned parents. Bullying in the early years can affect the brain and personality of a child so much - take it from someone who was bullied from the age of 2 by a girl 2 years older whose mother didn't care!