For me, if they are comfortable with it, I am comfortable with it. We are a pretty open family. I know my boys are younger than yours (5 and 19 months) but I think my opinion won't change any time soon.

As for the pool, I've seen signs at different pools around the place saying any boys over 6 have to use the male change rooms or the family change room.