I think it might pay to pop over and explain that your baby sleeps between x and y o'clock and ask very politely if they could bounce their ball outside of these times? Apologise profusely for asking (of course) and be absolutely sweet as pie about asking. Even if you get a reduction in frequency that would help, right?