If he's not worried, I wouldn't be. I know that it's a pain, but if you worry him about it, he'll worry. Can you ask the class teacher if he has any friends in the classroom?

DS has very few friends, but it worries him so I'm now involving his teacher. We have playdates and he's great one on one, but not at school with the unstructured play.