I don't think you're being overprotective at all!! I don't think it matters who it is you wouldn't want them to just take your kids out all the time!
I suppose it's a bit hard until they arrive and you know what they're expecting...Maybe just make sure you chat to dh about it first and let him know what you're comfortable with so that he can tell them what you both expect iykwim?