Yes, it's pretty normal, it's all just part of exploring their bodies.

Sometimes they do it on and off for a few months, but sooner or later they learn that it never ends very pleasantly, and they stop doing it.

Try not to worry too much about it.