i would have been fine to do that, as a once off, if i was leaving baby with DH. i would probably get dh to come to the place, and then drive around or read in the car if baby was asleep or take her for a walk in the carrier if she was awake. i wouldn't stress too much about leaving milk if you fed just before you left.