I agree it sounds like the tax free threshold, which you can only claim for one job.
If you have not claimed the tax free threshold you should be paying too much tax, not too little.

For them to not be taking any tax out at all is a mistake on your employers part -- there is no option to you to choose not to pay it

Check with your employer and, if they have made a mistake with your tax, check they are paying your super too!