hi
i'd just stop it. since he seems to be over it and not looking for it.
as alternative, you could express for few nights and store in the freezer.
in this way if he changes his mind your milk supply is still there...
good luck