Is there a different 'Olly' name that you like? Ollian? Ollivander? Ollis?

We gave our sons one name we considered a bit more conservative (that's Si's first name, and Riv's middle name), so they have options. I know many people who are known by their middle names.
So you could always go for a more conservative middle name.