DD2 was the same, and by about day 4/5 I ran into real problems. I expressed about half the breast she wasn't feeding from, for about 3 days, and they soon settled, plus I ended up with a grewat freezer stash! lol
Marley couldn't even latch on to them they were so hard, so I began expressing half the breast BEFORE she fed from it as well, which allowed her to ability to feed longer and latch properly, saving my nipples much heartache.

It will settle so make yourself comfy, and remember your supply at the moment is very much hormone drivem , not demand driven, so don't be too scared about creating issues with it. xx