You can't claim the tax free threshold with the second job so yes you do pay more tax.