I did until he could sit up well and now I don't. But I don't use a real bath but fill up the bottom of a deep shower. The floor of it isn't curved like a bath so is probably a bit safer. I still have my hands at the ready though in case he has a spill.