I did at at 3 months as DS was happier looking out than lying down. Now he is 6 months and happy to lie or sit up. Don't know if there is a "right" time to do it but it made going out and about with him much easier.