If it is the chlorine smell that bothers you, just fill a clear container and leave it on the bench for a while. Light will naturally cause the chlorine to form a gas and it will escape when you open the bottle. Then you can put it in the fridge to cool it.
Taste studies have shown that people can't tell the difference between bottled water and tap water treated this way.