Did you have an episiotomy by any chance or have alot of tearing?
I had an episiotomy and when i received my stitches, some tissue wasnt sewn properly and was left with a skin tag (flap of skin on the outside). This caused me alot of problems and until i had it removed, went through what you are describing.
If it continues, id go and get it checked out just incase.