I poke my baby to get it to move and feel what position it's in. Sometimes I feel it quickly move away when I do that. Am I hurting it?