I would say make a list of all the pros and cons, then do what you think is right for you, your baby and your family.
I'd do this. GL with your decision.