I would say dont push the issue as it will only make him dig his heels in more. I found when I wanted #1 i had to let him go and he made up his mind in his own time.
I also want #2 but DH isnt ready so I will wait and see how it goes.
We should be lucky with what we have however some people want a large family and I am sure that you and DH will come to a mutual agreeement.