My mum had this problem so she bought two spacers I think they're called. She put the charms opposite the clasp & the spacers either side & they stop the charms from sliding around. Sounds like you already have one, just need to get another.