I also went on a pill to speed up the milk drying up process about 6 weeks after DD. I still remember about 2 weeks after taking it, I was getting undressed for the shower and I squirted across the room. So for me, it took about a month to stop doing the random let down thing all together.