We have those little adhesive cable-clips for our toothbrushes - not pretty, but very functional.

I think your velcro dot idea would work fine as well - for a while, at least, because the soap and steam and water will make the adhesive fail after a bit, and it would need replacing. But I can't see velcro stopping a determined 2yo...

As for pictures, Ikea usually has a good range of generic framed images.