I moved DD1 into a toddler bed around 18mths and it was the worst thing I ever did! This time I am keeping DD2 in the cot as long as possible, three sounds reasonable to me! I'd do whatever works best for your family. I can't see this being detrimental to your DS.