Personally I LOVED the pocket as I would pop my keys in it when going for a walk around the block to put our baby sleep. But no, it doesn't affect the carrier if there is a pocket or not.