Maybe he's just too busy to be slowed down by a breast feed during the day. If you want to continue, maybe keep offering during the night to keep things going and just play it cool during the day. Trying to force it will only make him more resolute about not breastfeeding.