No, your not being overly sensitive - i think it makes perfect sense for you to want to have this time to bond with just you, your bub and DH, without peoples come in, and out and disturbing your time. I recall, very vaguely, someone said something once about only the mum and dad should hold the baby in the first 'x' amount of hours, cause the babies get used to your own particular smell/scent.