I would leave Milo with a trusted friend or family if I had that option.
As it is he is with my mum 2 days a week, and at creche for 3.