Pretty sure Chicken Pox is one of those ones that needs to be air born to catch it, like someone sneezes on you or exchange of saliva or persperation.
It is more contagious before the spots appear, can be just as contagious when the spots appear if they are pussy and you touch them.
If you only held baby, I would think your chances are pretty slim.