Yes, always. Your friends are being rude, especially if they know that you don't want your pets to get out. Imagine if a child went out the door with noone noticing. I think that it's common courtesy to leave things the way they are when you find them and if you're not sure then ask.