Growing up, we lived in a very multicultural enough area, and this is where I got the 'abo' slurs (man, how easy it would have been to just say "yes, I am, and proud of it"!). I now live in a bit of a 'whitebread' area, and this is where people politely assume I'm a kiwi!
If anyone ever questioned my dad about me, I never heard it. He is typically Celtic and I remember being slightly self-conscious and expecting people to ask him, when we'd be out together. I've got dark curly hair, which if it weren't for my skin tone would be much easier to attribute to my dad (who had dark hair before it turned white in his 20's, and it's very curly if he lets it grow beyond half a millimetre!), and olive sort of skin. Unless I've blocked it out, no-one said anything to us!