I cant see the vegemite being a problem, DD has it on her toast and i have put some on her rusks before, which would be rubbed straight onto the gum (??)
But im going to try Kelly's teething rusks!