The clothes you are getting rid of, If you take them to charity will be loved by someone else and help to raise funds too. Could you think of it as being kind and thoughtful that you're recycling the clothes?
Eta- buying clothes that are more expensive means that you will probably get years of use out of them instead of just 1 season.
I find it quite freeing to get rid of clothes I no longer wear. Hard to do though.