The small digital thermometers which can be put in the mouth or under the arms are good for newborns and are quite inexpensive. There are also ones which look like a bit of plastic and can be placed on their foreheads too.

When they refer to not putting anything in babies' ears, they mean more just cotton buds and cleaning, but those ear thermometers don't go all the way into the ear anyway.