Using Tea Tree/Eucalyptus Oil for cleaning when TTC/Pregnant/Breastfeeding... Is it s

I currently use Tea Tree and Eucalyptus for alot of my cleaning but it has just occured to me that it not recommended to use these oils when pregnant and possibly also when TTC and breastfeeding.

Should I continue using or change to something safer? Surely people that use bleach etc while TTC/Pregnant/Breastfeeding are using more dangerous chemicals yet it does not say not to use?

Any thoughts?

If it is a big no no do you have any recommendations on what to use?
DH hates the smell of vinegar so I cannot use that.
I love Enjo but do not have the money right at the moment to buy it all.
Are there any other natural products you use for cleaning?

Thanks for your thoughts and advice...