My update is my ex is becoming more erratic and now it is both him and his father harassing me. It's just all emotional verbal stuff so I am glad I have kept a diary of sorts from during the pregnancy and now the visits. He basically doesn't have any legal right to visit in my home and so now I am slowly stepping things up a bit in terms of formality and IF things ever go to court.

My advice is get legal advice and do write down any of his behaviours or incidents even if you do have very little contact, just in case.