We teach DD not to pick up rocks, not to go into long grass and not to dig in garden beds (don't forget about the spiders).
She also knows not to go near, just walk away quietly. But she's 4, not sure how I would have approached it with a littly.
We generally don't let the kids out without shoes either.