My DS did that too. As much I hate waking a sleeping baby, I woke him up if he started sleeping too long (as in more than 3 hours). I only had to do it twice.