Definitely let them cool. They form a crust as they cool down and this is how they come away from the paper. Most cupcakes if turned out hot will stick and crack.