Each to their own hun there is no right time for them to be having time away from you. All night is a long time!
That being said I can't even remember how old DS was! Between 6 and 12mths somewhere? But he spends time with my mum and MIL without us often.

sent from my watzamajig so may not make sense....