Hmmm well the peninsula is good because the beaches are so kid friendly in the bay, but if that's out. Wye river is nice. The big 4 there is well equipped for toddlers and the food at the pub is nice.
Philip Island?
A cabin at the prom?
Sandy Point?
Friends with kids love Lake Patterson, but i've never been there...