With my first bub i had every one around and coming to stay with us in our tiny 2 bed house, it was so stressful for me and by the time everyone left i was a mess.
I would tell people to come and visit while you are in the hospital, at least that way you dont have to worry about everyone invading your space and then tell them that while your Dh is home you dont want anyone to stay as you want to get to know your bub and have some time to your selves to get to know each other and get into a bit of a routine, although your dont mind visiters as long as they ring you first to see if it is alright to come around.
If you are close to your mum and feel you might need her there than by all means have her but mabe tell her befor hand that if you think you are coping and would like some space you might ask her to leave so please dont be offfended or take it personaly, at least that way she would be prepared and then not hurt by your request.
Good luck