Anything that is close to the CBD is going to be fairly exxy. What kind of accomodation do you want- hotel, motel, caravan, cabin......
Public transport (buses, ferries) is mostly pretty good to get to the city so shouldn't be too much of a problem (if you can avoid the trains!) if you're a little bit from the actual CBD. How far from the city is too far for you?