The problem with food poisoining is that everyone always thinks it was the last thing they ate, which is not always true. Some bugs can take three days to incubate and cause symptoms. Unless you are absolutely 100% sure it was from there, I would leave it.