We solved this problem by budgeting in pocket money into our budget, for the same very reason- I would spend and DH would feel like he deserved the same etc. So now we have a budget of $50 each a week to spend on whatever we please, for me it usually clothes shoes etc, and for DH is is stuff for his garden, pond etc. Bigger stuff we usually discuss and then budget/ save for.