this is why you should never tell family and friends until after the baby is born. once he is here and he looks like a little Raffy none of them will have the balls to say anything negative to you.
just go for it, in the end he's your baby and they will all learn to live with whatever you end up calling him...and who knows, some of them may even end up liking it!