I prefer Riley to be spelled Riley for either sex, though it I had to choose a different spelling for a girl, I would go with Rylie (which you have for a boy). I don't like Rylee or Rilee because the double EE makes it look like a kid misspelled the name.

If your husband doesn't like Ayla or Asha, here are some similar names you might like: Ada, Aida, Aisha, Aria, Ava, Isla.