Don't stress you'll be ok!
Colds and viral infections are actually quite common during pregnancy because the body suppresses the immune system a bit while you're pregnant.
When I was 20 weeks pregnant with Emily I had a shocking cold/flu with temperatures, chills, snot, cough - the works. I then ended up with a chest infection... Put me off work for two weeks. She was fine throughout the whole thing.
I also had something similar when pregnant with Toby but not as bad. He too was fine. They're pretty tough and well protected in there. Cold and flu viruses are very common in the environment and our bodies know how to deal with them, bubs will be fine