Can you look into re homing him somewhere more suitable? I've got a friend who runs a cat re-homing charity, there may be something similar in your area? You could call your vet or pound or similar and ask if they know anyone who would help you re-home?