I am sure that using just bolied tap water is just fine. Unless of course your water is really fithy

But yes, tap water boiled is perfect for your babies bottles.