I use rice milk in everything. It is naturally quite sweet. It works fine as a replacement in baking. I like almond milk, but it's expensive and has added sugar so I don't buy it. You can get rice milk and oat milk in the aisle with the UHT milks. Some supermarkets also have rice milk in the fridges.

You can make your own rice and oat milks, but not a great idea for your DD in particular as they don't have the same added vitamins as the commercial brands. Yes, you could make sure she was getting calcium through other sources, but easier to have it in the milk.