Henry is an absolutely gorgoeus name. I have recently heard the names George and Stanley - which i think probably come from the same era. Looking in a name book you may think - too old sounding, but when you meet the children with those names you begin to like the sound of them.
I'd say go for it. There are way more weird sounding names out there