" sounds more like someone who despises the wealthy, or does not value wealth or its pursuit, or doesn't want, need, or spend much money. If what you are trying to say is that someone has a lot of money and doesn't care how he spends it, you might try reworking your example into something like this: "I don't give great thought to spending money. "
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.