I think this is a condition called Klinefelter Syndrome, and the most common feature is that the men don't produce as much testosterone as other men, and can be slow to develop during puberty. Though testosterone therapy is usually used and can be an excellent treatment. Most men with Klinefelter Syndrome are also infertilty.

ETA: Good info Tanya