It also disparages extreme wealth as somehow being obscene; as if someone obtained it immorally or illegally.
It reminds me of the terms "robber barons" and "filthy lucre." In modern times, I would describe a few of the big scam artists and drug cartel scions as "filthy rich."