Not that I have bottle fed but especially a young baby I would heat it up as breastmilk is heated to about 37 degrees which is mums body temperature. Otherwise baby is taking energy to warm itself back up instead of digesting and putting that energy to good use. When the baby is older though room temperature would be ok.