Absolutely change. You need to feel comfortable and safe with this person and right now, you are not. Hope you find someone lovely