Sounds like a debt collector or someone to me. I wouldn't have given out the phone number though, I would have offered to take a number and reference and got him to call back and if they refused I would have said "well it can't be that important then so you'll just have to hope you catch him at home next time" or words to that effect.