If he's happy & not lethargic I wouldn't worry too much. It would be normal in this weather for his skin to feel warm but his actual body temp to be normal KWIM?
I tend to dress & wrap according to how their skin feels, so if he feels cool to touch then more layers, if he feels warm, then less.... his body temp tells you that everything's otherwise ok.

ETA - and like Olive said sometimes it's better not to use your hand, I use a kiss on the forehead