Boys just love their daddys they strive for their attention and just to be like them it wouldnt matter if you gave him all the attention in the world, I swear its imprinted in their DNA. Try not to be so hard on yourself your just as important and loved the same even if he doesnt show it. I know where your coming from I been there too, it does get easier