I just remembered the name!! It's the Caroline Chisholm Society and their main base in Moonee Ponds. It's not a refuge as such, more of a support place.