I got some beautiful removable wall decals from giggle smiles designs website. They are great, it's the only way I decorate my kids rooms walls.

You can get pictures with nice prints in them and use Command Adhesive Hooks to hang them up.

You could even wrap a plain canvas in the same material as the curtains you are planning on and hang the canvas up using the command strips.