I wouldn't have a problem with it but I'd want the kids to know the nanny first.

As an alternative, could you fly the kids down to your inlaws?