We never used one. We would hold him in the big bath when he was little (which does get a little tiring after a while, to be honest) and then once he could sit up we just sat him in there on a non-slip mat.
I'm sure some of them are probably really handy early on, especially if you have a bad back or anything like that.