Anyone have a baby who absolutely refuses to have a blanket on?

I used to wait til he was asleep, but now it wakes him up when I put it on! Its making co sleeping not so much fun!!

Anyone have a brilliant solution??