The only reason I believe I wont be able to drive is when my belly touches the wheel - which is fair enough. I dont believe just 'being' pregnant impairs my driving ability.
Do you need a doctor to tell you that your belly is touching the wheel? Most car seats and steering wheels can adjust these days.