WOW! I cant believe he has the nerve to tell you YOUR wedding is going to be "weird" at the end of the day its between you and your DH who you want to be in the church. He has no right to expect anything. You have asked him to come celebrate the uniting as 1 not just a anyday hooohaa party!
If he doesnt like that then tuff luck tell him his not wanted.
Please dont even consider changing the venue.

I think your wedding sounds lovely- dont let this "friend" bring it down!