Because the context doesn't fit, if you turn down it, it would have to be something like a road or some other path that you would turn down. Turn down the job would be ok though, so I'm thinking it has to do with it not being a noun.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.