With how warm it has still bean I personally wouldn't leave it out to come to room temp on its own.
I think its if the room is 26 degree or less its ok to do that.
I would warm it to body temp just before you use it. Best way to do that is to simply rotate the bottle under running hot tap water.