I'd say safety, given that your centre of balance changes, and also that you have the hormone relaxin at work, increasing your risk of a pulled muscle - heels aren't that great on the ankle really.
I imagine in your later pregnancy as you get bigger you'll be more motivated to make the switch. In the meantime, can you stick to low heels?