BW, I can imagine your distress at these incidents, though I wouldn't pull him out just yet. I would maybe write down all of your concerns and talk to the director and the carer in charge in the room. Some of the things you mention I would think might just be 'one of those things'- there could be innocent reasons for some of the things happening.
Like when he fell asleep in his nappy in the pram unwrapped. Maybe he was a bit upset with new teeth coming and just settled in the pram that way so they left him there, and with him falling asleep earlier than normal, I would think he would be more tired than he would be at home so maybe he just can't make it til 4pm. But the other things, like not wrapping him continuously to sleep, and not giving him his bottle on time, letting him have his dummy if you have asked them not to give it to him. They are things they should be doing every time no matter what.
I would firstly take it up with the director and room leader. If nothing is done, take it the next step, to their manager, and then take him out. You will probably need to give 2 weeks notice anyway, and if you recieve and centrelink payments, you will need to take him those days to recieve it.