I would try on before you buy if you can, either at a store or a babywearing meet. It really seems to be a matter of personal preference.

I used to have an ergo and the infant insert can be very warm (but its lovely and snuggly for winter bubs)