I think when they can hold their own head up by themselves. I can't remember when DS went in it without the insert either! Sorry, I wasn't much help was I?!