I think you should sit down together and really nut out all the pros and cons of both choices and really consider the time it will take, your lifestyle during transitions (building and renovating and moving), and how much it will cost to achieve both.

There are obvious pros and cons to both. You just need to really brainstorm it all out thoroughly before you make a decision.