Does your older son have any idea about any issues with your younger one and friends? Sometimes kids can be quite perceptive.

I would say that if your older son and his mates play with the younger one without minding, then it means your son does have friends - his older brother and his mates.

As it doesn't bother him, and he is interacting with others at breaks, personally I wouldn't worry too much.