It can work really well in your situation where there are no distractions, since DS is in bed and DH is at work. Are you going to miss the "you time"? As the others have said, set strict boundaries on when they can call, and also with your family, that now is work time, not to call or expect favours etc etc. I hope it works really well for you.