what about daylesford? not too many shops but you could pick a market day, there are some nice, gentle walks in the area & the overall vibe is quite peaceful.

or somewhere in the dandenongs.

i haven't done the queenscliff-sorrento ferry in many years but it was good.

lunch at the portsea (or sorrento) pub & look over the water while you have lunch - although kinda busy during the holiday season.

i've always wanted to go to the royal mail hotel in dunkeld for a meal - but i think that's probably well over a 2 hour drive (food is meant to be amazing though!)