You can keep you handbags for when you are out on your own and there are plenty of nappy bags that just look like oversized handbags. I have a Storksak Julie which I don't think looks like a nappy bag at all, I love it

I have my eye on the Storksak Elizabeth haha I am nappy bag obsessed!