You might say this to mean that whatever "that" is, is not relevant. For example, you are very sick and are discussing surgery options with your doctor. " His coment is not relevant to any part of the discussion regarding your surgery.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.