Next time you have them over make sure you ask them to bring something - then it will all even out

I am the same as you, I wouldn't expect a guest to bring anything to something I am hosting but I would take something small to someone else's house.