Like MantaRay said, a b/f bub shouldn't need water until they're starting to wean. Having said that, it doesn't hurt them to have it (as long as it's not impacting on your b/feeding).

My two started off by playing with it more than drinking it. It wasn't till they were about 14 months that they became interested in drinking it regularly.