I think whatever feels right to you is the right thing to do if you dont want to leave him, then dont let anyone make you feel like you're bring ott. TFB had some good suggestions if you wanted to find a compromise.

Ultimately though you need to feel comfortable with your choice.

Sent from my GT-I9100 using Tapatalk 2