Maybe he just gets along better with older kids? If he plays with his brother who has a lot of friends maybe these are his friends too? I wouldn't worry if your son doesn't seem sad.