I was also like that when I first left Ash. I kept worrying if she was coping without me and feeling as though I'd just abandoned her!
Yes it does get easier, after a few times you begin to realise that they are fine with others and we are the ones that are upset and stressed not them.
I do prefer if Ash can be looked after at home but can't always be the case. I think it was more in those first few months that she was hard to settle so if she needed a sleep in my absence I wanted her to be in her own environment.