Hollye - our cat was exactly the same - we tried the squirt bottle with water and that didn't work either - he would just do it when we weren't home! u can buy a spray at the vet that dosent smell good to them and its suppose to keep them away but once again that didnt work on our cat either!
Goodluck tho! sorry i was no help - but definatly give the water a go!