You will be totally fine..
I am flying with a 2 weeks old in August and a 23 month old and a 3 year old.

My ears also kill me when flying but knock on wood my kids will be fine again this time.