I'd wear a nice frock with heels, definitely suit and tie for DH if the invite says smart formal. No jacket and tie is smart casual, like you said he can always remove them if appropriate.