First things first is to check with the council to see if that particular plant is under a preservation order (ie native to victoria, over a certain size etc) because you will need a permit to remove it.

Then make the decision as to whether you will attempt to save it or get rid of it.