It definitely takes time. After all, you both have to get acquainted and learn all about feeding, burping, crying, sleeping etc. All of that stuff can sometimes get in the way.
I think once I learned to stop and watch and listen instead of work myself up into a frenzy, it got a bit easier. I managed to observe Gabby a little more and not worry so much about what she "should" be doing iykwim?