I have a pure bred Ragdoll..she is lazy, placid and floppy, has a few mad moments, nothing agressive. She is also an indoor cat only so has never had to fend for herself. It was also a reccommendation from the breeder to keep her indoor as Ragdolls are normally indoor only cats a general rule due their placid temperament and not being able to fend for themselves very well.
I would be contacting the breeder to see if you can return him. I know it's a long time to have him, it' just that he may have something wrong with him psychologically.
You could also talk to a vet about putting him on Cat Valium if you want to keep him.
His behaviour doesn't sound like he would tolerate a toddler or a new baby. My DD can pull our Cats tail and pretty much do anything and the cat just walks away.
Good luck with your decision.