I agree with giving something else for distraction, DD2 would always play with my necklace but has certainly gone through stages where scratching at my face or neck seemed 'fun'.
I also found a short sharp NO was enough to kind of startle her into stopping.