Thanks ladies, your advice was what I was thinking I should do and it is what I always think, if in doubt then call, but I guess I just needed someone to tell me it is the right thing to do IWKWIM.

So I called the birthing unit and they said go to the Dr first thing in the morning and ask for a swab test and ask for a rush on the results. The Midwife also said they should have tested me straight away knowing I was pregnant.
Fingers crossed that it is just a flu symptom and that no harm has been done.