I guess it depends on how important it is for you to return to work. If it's doable for you to take another couple of months so that you can find somewhere that he will be happier then I would be inclined to follow that path.
He will be spending a substantial part of his time in this place so it's important that he's happy.