I would see someone about it too if it's inside. If on the outer labia could it be an ingrown hair or pimple? If it's so sore it's probably worth seeing someone even just to see if it'd be appropriate to get a local anaesthetic cream until it heals itself. Hope it's better soon.