That's the exact sort of wedding that *I* want. Just people you actually want there and not all the blow in's that you feel oblidged to invite. DF thinks if I have a small low key wedding I'll regret it as he thinks every girl wants the 30K wedding. Pffttt! No way in hell!
I think what you're doing sounds lovely, and at the end of the day, it's for you guys and not everyone else.