Exercise can stimulate bowel movements - swimming is a pretty whole-body form of exercise. If it was any more than one bowel movement each time, then probably more of a point of concern. But if it's self-limiting then I guess it may just be normal? But if you're worried, trust your mummy instinct and by all means mention it next time you're at the GP.