I don't have a problem with it but I would be wary of disrespecting the culture I was using the name of. I would want to research and understand the meaning, history, significance etc and if I couldn't get a clear feeling about it would not use it. I would never want to seem like I was using a name without understanding it, "stealing" it without disregard type thing. I don't know if I'm explaining what I mean well but yeah.
No, makes perfect sense to me, I feel the same. I'd only give my kids 'anglo' names because DH and I are through-and-through Anglo-Saxon and we would feel as though we were being disrespectful if we were to use names from other cultures without *really* knowing what we were doing. I've heard some names from different ethnic groups that sound beautiful, flow really well and are just 'pretty', but I wouldn't feel comfortable using them for my own children because as others have said, it kind of puts an image in your head of what the child would/should look like and might be a bit odd with an Irish name (our surname)!