I'd vote on the smaller house, extend later. BUT make sure you are allowed to extend - check for easements etc when you are looking at something.