You always treat the ones you love most the worst they say. Its probably because he is so secure in your love that he knows no matter what happens you are there for him and will love him so he doesn't need to cling to you.
BTW no matter how reassuring we all are i kow how much it must hurt you.