If you don't want bubs having it or don't wont to be woken up to put it back in I would prob just try & rid it.
Otherwise like other comforts, if it's how bubs gets off to sleep it prob what he will be expecting when he wakes during the night...therefore you might find he wakes sooner without it IYKWIM. If it works you could always just run with it.
I was lucky Charlie did not wake for his often & once old enough we attached it to his sleeping bag with a dummy chain & he now finds it himself not a worry.