Totally understand where you're coming from. I'm the same!
When our chooks were little, one got through the back neighbours fence and their dog ate it But even then I still didn't have the heart to keep them locked up, instead I got DH to change the fence, haha.
I've got friends with 5 chooks and they keep them in their little fenced cage, very very rarely let them out. Poor little things