Are you renting or buying? If it's renting I would move to the area I didn't really like for the bigger house. If your buying you can always extend later if you can afford it financially so I would take the smaller house. Also with buying your stuck were you are so it's better to be happy with the decision.