It's really your decision, if you don't want to go then don't.....you don't expose your child to that food etc until you are ready or want to.

Just wanted to really say that they shouldn't need to know why you are not going, just say nicely you are not free. I wouldn't go into why, I'm sure it will not affect anyone else opinon of you etc.