Well thats 3 strikes for sure.

You KNOW you didn't do anything wrong, please, please don't talk to him again unless its to work out when he will be visiting the children or something similar. He doesn't deserve you and I think he plays games.