It's a tough one seeing that I don't do either!

Personally I think smoking is worse from a long term perspective. I'm thinking absolute worst case scenarios here but I think that a cancer that is lethal that was caused by inhaling second hand smoke would be worse than the emotional trauma that could require counselling and therapy. (I am making a big assumption that you mean a one off smack and not a beating here as well).