It's quite normal. I'm not sure if it stops, or just becomes less forceful so doesn't actulaly come out unless there's sucking.
Do you apply pressure on the other side when feeding?