you are not doing anything wrong, you are recignising that he isnt getting enough and doing something about it.
it is better that you do what you feel you need to and relax knowing he is getting what he needs, then to keep going and stressing that he isnt getting enough.
for me the sleep deprivation of them constantly feeding was enough to make the swich, once i had 'proper' sleep i knew it was the right choice. and altho id like to make 6 months this time, i know if i have to stop then it is the right thing for her, and she will still be my baby with out the boobie.

no idea if any of this make sence, sorry.