I usually wait until after the morphology/anatomy scan, so around 21 weeks.

As we'd lost Noah 3 months before conceiving DS2, when pregnant with DS2 I waited until the very last minute to take things off lay bye. I figured it was as good as buying them but not feeling like I was jinxing myself by having them at home. From memory, we set things up at about 37 weeks.