You need to do what you feel is right for your baby. It is hard when you get conflicting information and especially hard when you're tired and stressed out.
I very, very much doubt that any mother will look back in her old age and think: Oh I wish I hadn't held them as much as I did.
The truth is, we don't know how much time we have together - why waste it feeling bad about doing something that feels wrong?