If it were me I'd move him because once I think of something like that I will keep thinking about it until I actually do something about it. You see a car has gone through someones house nearly every week on the news. So if it's worrying you do it.