If it were me, I wouldn't take him there. You don't want to create a fear that he'll associate with swimming, which may lead to a fear of water, IYKWIM? And, if he's terrified, he's not going to enjoy it anyway.

Maybe ask if you can postpone his lessons for a month or two and try taking him back when he's a little older?