My ankles and fingers were swollen from fairly early on too - I think from about 10wks or so. But they've stayed roughly the same and haven't gotten any worse.

The things that helped were lymphatic drainage massage, drinking HEAPS of water, swimming, and ... from a purely practical point of view ... putting my shoes on the minute I got out of bed. Otherwise, if I had breakfast/shower etc first, my ankles were too swollen to fit my shoes on.