Can I say that "had" cannot be used here because the sentence itself seems to be a conversational speech than a reported speech?-- That is one use of the past perfect, but you cannot say it of the given sentence because that is not the reason for its incorrectness.
I am unfamiliar with your #3. Is that not just one instance of #4 (Conditional III)?