I would go for it. Like you said you can make it very special and intimate and keep it to whatever budget you want it to be.

We had our wedding at my Mums house because she had such beautiful gardens but I love your DH sentimental way of thinking.

Its your day dont worry about what anyone else thinks, im sure you have only wonderful friends who will just be glad to be there celebrating with you.