I had the same thing happen a couple of years ago too Sarah, someone was putting money into our account every fortnight, and the same amount each time. I called the bank to let them know and they said there was nothing they could do until the person depositing the amount told them, even though they knew who it was (they told me his name and asked if i knew him)
I think i had 4 payments go in before it stopped