If you are getting enough calcium you will be fine.
If you aren't getting enough, of any vitamin/mineral, pregnant or not you body will take it from where it can.