If your DH has crunched the numbers and they don't add up right then I would agree with him and say that now is not the time to refinance. You don't need to save up for everything that needs doing just do it bit by bit.