Bella used to do this all the time too. We purchased a wide black band that buttons around wone strap and then around the other and its to wide to let her get her arms out - its such an awesome little gadget! And it only cost us $20 - wel well worth it!

We bought ours from Oakies - but im pretty sure the would be at any big baby shop.