we use peanut butter or melted chocolate that then sets and they cant get it off.

depending on where you live, having mice can attract snakes, so there another vote for getting a cat