I wouldn't worry about it. He doesn't need milk. Just make sure that he has 3 serves of calcium a day. If he is having yoghurt and cheese he probably gets that now anyway, and there are plenty of non-dairy sources of calcium as well. Truth be told he is probably better off just drinking water.