Sarah, I read somewhere that cats don't like the smell of citrus so maybe you could try spraying something with a cirtus scent around the areas you don't want him to go...

I had the same problem when my kittens came they home (on our doona, on their little bed)... I ended up just removing the items in question. I know it's impossible to remove everything though...