My DD2 is Poppy and one of the boys in my DD1's class (grade 3) turned to his mum and said 'but she doesn't look anything like my poppy!'.

Nah, I don't think it would be confusing. If you like it, go for it!