No I wouldn't - not for an hour or two. Maybe, possibly in exceptional circumstances if I had to duck out to the shops at the end of my street which is a five minute round-trip (walking).

What's SD doing when he goes out? Is there any reason he can't take your bro with him?