If you would like to be included more often, could you offer to host once a month or something? Or is it done outside of the home? I would feel left out too, so it's not just you. You say you don't have the time, maybe they sense that too, and that's why invites are few and far between?