Of 30 citations for 'glutton for' in the Corpus of Contemporary English, 21 were followed by 'punishment'. It's clear that other words can be used to follow this, but they run the risk of sounding a little strange. You can't really be a glutton for something that most of us would regard as pleasant.