I think its illegal in most local council laws to have an inground pool or an above ground pool of a certain depth unfenced.

I don't know if I'd go... it only takes a short time for a child to drown, no matter how well supervised accidents happen and I'd never forgive yourself if something happened. That said, if its easy and safe to lock all backyard access doors, then I don't see why not.