Yeah I honestly would rehome them if you are feeling you can't give them the attention they need. My fur-baby might not have me ALL to myself, but she's adjusted as have I with kids. And at night when I hop into bed its "our" time. She snuggles with me, purrs and mooches all over me. I still love her, and I still give her attention, but if I felt like I hated her, or her me I would definitely look at rehoming so she could have a better life.