The agent could be hassling you because they have told the vendor that they can have the early deposit. We were told that by our agent when we sold but once the deposit was paid, then it was a different story and nothing was handed over until settlement. I understand that people often need that money to pay off debts etc, but if I was the purchaser, I'd be wary. If you're in the position to, I'd bring forward settlement instead.