Ide say just go with it. He will might pick it back up again when they weather gets warmer. Is he eating solids? Remember to always offer the breast before any solids meal.