Its up to you if you keep going with the milk bottles, but it is suggested that they have milk from a cup from 12 months to save dental issues.

Plenty of kids have milk bottles past 2 or 3, but it can cause issues. With teeth as well as diet. If its easy enough I'd try dropping one & see how you go