It might improve as you get bigger funnily enough! I had pains around 20-26 week mark with minw but am now comfortably able to swim 1km. It might be to do with where the baby is and where the pressure is in the uterus - but that's just a guess as that's what it feels like IYKWIM.