Purchases are something you choose to spend money on. These might be spontaneous (beware of the impulse buy!) or planned for months. Either way, you should consider them carefully!
Expenses are things you have to pay for, things like rent, or the electric bill. You can't choose to not pay rent! Expenses are a fact of life, but you should budget for them. And don't forget annual expenses like insurance!