Is he lying down the whole time or sitting up in the pram? Perhaps if he is seeing people as you walk around he might get distracted or if he hates sitting up then lay him down and see if that works as perhaps he is getting over stimulated?
Also is he ok until he gets tired, then loses it when you put the hood down?

Sorry for the all the questions just trying to get a clearer picture