Salsa, stamp duty on transfer is a government fee and varies from state to state. From what I understand, in VIC you still have to pay stamp duty even as a first home buyer (in NSW you don't pay stamp duty if your first home purchase is $500k or under). The duty increases depending on the purchase price of the house. It is usually a good few thousand dollars.
Registration of mortgage is about $100 in NSW - I am pretty sure that's another govt charge, but can't remember.
Mortgage stamp duty is payable for some lenders. Some lenders waive this fee. It is often a few hundred dollars, but varies from lender to lender. Lenders will also have other fees, like an establishment fee or a settlement fee. Ask your lender or your broker to give you a full breakdown of fees when you are investigating which product would suit you best.
Lenders mortgage insurance (LMI) is payable when you want to borrow more than 80% of the value of the property. It doesn't protect you, it protects the lender. LMI increases as the amount you wish to borrow increases. [Hollo: $4,800 is annoying yes, but it's actually pretty conservative. I have seen people pay over $10k in LMI recently. It is ridiculous.]
I am not sure if all brokers in Australia are free. The ones I work for are: they are paid on a commission basis by the lender, and they disclose all those details to you if you decide to go ahead and apply for your loan through them.
If I were to buy a house (DH and I will look into it in about 5 years) then I would go through a broker.

ETA: Yes, you'll also need to pay legal/conveyancing fees. These can be $1,000-$3,000.