No, not selfish at all. My DD was an emergency c/s. There was 8 hours between her birth and my MIL and ALL her family visiting. I was so dopey from the GA, and so hugely overwhelmed that DH and I decided with DS that we would ban everyone from visiting on the first day.
We knew for months and months beforehand the date of DS arrival, but didn't tell the IL's. Think we may have told them in the last trimester? Then DH dropped the bomb that we weren't having visitors the first day. MIL wasn't impressed, but I wasn't having her get in the way of my first memories this time round.

We told her that we wanted time as a family first. for DD to have some time with her new sibling without everyone hovering around.

Do you know what the visiting hours are? We were lucky that visiting hours started at something like 3pm. So I didn't have to see them for a whole day and a half...was pure bliss!