Have you tried some tummy time why he is lying on you? Then he can see your face and feel you and might be a bit happier. A mirror that he can see while lying on his tummy can also help stretch out the time. Sometimes, bubs are a bit funny about tummy time just bc they can't see what is going on or want something to look at.

k