I would say possibly thrush too. My DD has had it a few times, once whne she was tiny and the symptoms sound similar. I would go to the GP. You will need to get some cream to treat it, or you can use natural yogurt and/or gentian violet/garlic but you would have to ask if those sorts of natural methods are suitable for a newborn.