Our OB said it would be a waste of time testing for downs due to our age, so we didnt bother.

If it is really troubling you, go and see your doctor and say, what are my options at this point?