Speaking from my own experiences here, it's a decision you definitely need to make for yourself. By all means take his thoughts and feelings into consideration, but at the end of the day you will be the one who will have to live with the decision you make. There is no right or wrong answer.

MrsB is right, make sure you have a few real life support people around you that you can talk to, that will let you cry and rant and do what you need to do. It is one of the hardest decisions you will ever be faced with, no matter what the end choice you make is. Particularly as it sounds like you have very different expectations of the future and what your relationship will be like.

I'm happy to talk with you about how I made the decision for myself and the process I went through to actually have the termination - PM me if you like.

All the best hon, hoping you get the support you need in this confusing time