Can you (or your dh) tell them that you as a family see him as 'your' nephew and cousin, and you'd like to have a relationship with him as a family? It must be hard with his family being like that. Kind of sounds like they are trying to come between the two of you?!