I agree with Misty. If you are concerned they are being neglected or not cared for properly perhaps you should go to court to change the care arrangements. Otherwise, it's kind of between them, infuriating as it may be to you. Kids are smart. They will work it out and his relationship with them may not be as strong as it could have been.