this is strange isnt it! I would take him back when he is due to go sat?, and see how he is. mayb try talking to him about the swimming and all that ( im sure you have done this). See how he goes on the next visit and decide from there. hope its ok