I think a stationary bike when pg is ok, but not a normal bike, as your centre of gravity shifts when pg, and you could easily lose your balance and tip the bike over...
You need to be cautious with weights because of all of the extra relaxin in your body, as it could be easier to strain and pull a ligament or muscle.

However during TTC all of that should be perfectly fine...