There are strap extensions if it's ok for him otherwise.
Otherwise maybe a Mei Tai? They're more adjustable so could work for both of you. (I have a blue one you're welcome to if you want)