I think Phillip Island is an awesome spot for a toddler/family holiday. There's lots of adventure parks, wildlife parks- you can go and see koalas and then go and see the penguin parade at night. There's a big indoor play centre there and nice quiet beaches to go walking along.