Yeah, it's hard to find a way to take the dummy away without toooo many tears. When I took the girls dummies away from them I kept them and just recently found them, 20 years+ and had a good laugh.
As for the thumb sucking you can try a bandaid on the thumb or try mustard or the stuff you put on nails to stop chewing them.
Also during the day pull the thumb out of their mouth.