Wow. He's going to be fabulous support for you with that sort of attitude.
I imagine he will be asked to leave and/or arrested if he tries to break down doors to be there if you don't want him. In any event, get some legal advice pronto so you can have some piece of mind before birthing.