Anything he does that could possibly hurt you is not ok. He knew very well that if you found out about this you would be hurt. He knew it was wrong. He knew exactly what he was doing. The fact that it was hidden proves it.

If he's going to fix this, he needs to be honest & open about everything. He needs to put in the effort. He needs to regain your trust any way that you need him too.