That doesn't sound good. Can you get to a gp to check it?

Sometimes I would have blood coming out when breastfeeding but that was because a blood vessel burst inside.

I've heard of people having rusty coloured milk too which can be normal when first starting feeding again.