I think it depends whether your loan is fixed rate or variable.

If it's fixed it could cost a lot to get out of it early and it depends on wholesale interest rates.

If it's variable rate it could be a lot cheaper. It just depends what's in your contract, and who you refinance with (i.e. NAB will pay your exit fees for a variable loan if your go across from specific banks)