Most people will probably say you have to, and honestly it will of course depend on your boy, but personally I think kids are a whole lot more adaptive than we sometimes give them credit for. They 'get' that sometimes it's different - like if mummy's been away all day, or if they're teething or sick, for eg.
I did allow DS to feed overnight when he was sick and it didn't cause any issues.