To check if bub is too hot or cold i was advised to feel the back of their neck and/or back. That will give the best indicator of their body temp.

Did she feel cold when you went in? If she feels warm on her neck/back then she is.

Don;t go be the feet or hands though as they can feel cool, but the body is warm iykwim.