If it doesn't bother you, then I'd leave it.
My little guy used to go to bed around 11. It nearly killed me. That meant I had not a single minute to myself all day as DD gets up before 6.
For some reason he'd go to bed at 6 because he was tired but only do one sleep cycle and then be up until 11.
We started not letting him get up and laying with him until he went back to sleep. Now he goes to bed at 6. He does wake up lots but he goes back to sleep pretty quick. He has started to get up about an hour earlier but I can deal with that, rather that than the late bedtime. Plus he gets about 5 extra hours sleep so one less is no biggie.
Much much nicer.