I was exposed to chickenpox when I was PG with Mason and my Dr told me it's the high temperature that can cause damage moreso than the virus.
Best if you chat to your Dr about it though to find out for sure, though there isn't much you can do if you've already been exposed to it.

that you will be fine.