i have done something similar to gymbaroo - but waited until DD#1 was 18 months i think.....i dont know if they start them that early (6 wks). Im sure someone could tell you.
I still take my girls swimming in the winter. Its like a big warm bath !!! They dont start the little ones till they are 6 months....but i have heard of other places being earlier.