Its always hard when you want that special time to yourself but EVERYONE else thinks they are also "entitled" to be there. Good on you for standing your ground.I would make it perfectly clear that they are all welcome to come over (even if its at the same time) BUT they ALL must book their own accommodation and check with you on suitable days for visiting.
I personally dislike the idea of you going to them with such a young baby, I recall what I was like and the first six weeks I was a walking zombie there was no way I was up for visiting other people or travelling even 30 min let alone flying to another State ... thats just my personal opinion.
You might find that some people think they are the "exception to the rule" so you will need to be strong but polite about other people respecting your wishes. I didn't want ANYONE but DH the day DD was born to visit but ended up with MIL, SIL and my mother all at once. I was soooooooooo tired and really did not want them there. I even hinted they had out stayed their welcome but my comments were ignored.
I know it seems impossible now but I think the way to go is to let them come whenever they like, stay in their own accommodation and have scheduled visits with you and bub, some days you may want them to visit lots, other days you might not want to see anyone, so doing it this way you'll be able to have the time with each of the family members and time to yourself.
hugs Nae x x