I was exactly the same, i remember actually feeling quite peed off, like when you have a house guest who over stays thier welcome and you just want them to leave so you can have you house and your DH back to your self!!! In my last few weeks of pregnancy i felt like that some days, but it hasnt been like that atall, We make a great family and we still have some moments to our selves, And its not like i thought it would be, the LOs dont detract from your relationship, they enrich it!
I feel the same now when i think about having another one day, like it would just get in the way of my beautiful family and the 3 of US, but i know it wouldnt be like that!!!
Dont give your self a hard time. Hugs to you