We haven't gotten rid of the dummy yet, but for the moment it hasn't caused any problems. My pet hate (one of many..lol) is seeing toddlers wandering around with a dummy in their mouth, so I've made sure DD knows she only has her dummy when it is sleep time, and she quite happily chucks it back in her cot when I get her up.