I flew to NZ in my first trimester and the only thing my OB said was that I should wear compression stockings to avoid DVT. These are available at the chemist for around $30.

If all the medical advice supports the trip, then go for it. It would make a nice babymoon for you both. It will be a long time before you and your DP will have time alone like that again.