I don't think that a few rolls a day will do any damage to your health. Some fish can have high mercury levels but if you're not eating fish that's no concern.
From a weightloss perspective sushi rice has lots of carbs and it's also made with sugar so it's not as slimming as you'd imagine.