"that same crowd would pay money to stare at you" is an undesirable thing in this case. They would be staring at him as if he was some kind of freak or weirdo. That is what he is afraid of (according to the speaker).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.