I would give an ultimatum, that it was the first - and will be the only time! I wouldn't leave as I think parenting is a tough gig and we all make mistakes and he should be given the opportunity to change and redeem himself.

I would let him know it is not on and not in any way an appropriate way for an adult to manage their emotions, that he needs to do some parenting and anger management classes (which he needs to attend) and if it happens again you will be booting him out the door and having him charged with child assault.