In my experience, more than a few people use the past perfect in situations like this, as a sort of "polite" inquiry, or non-accusatory way of reminding someone of what they said in the simple past. Though common, it's not correct.
Why do you keep giving me so much work? (reply) You had said you wanted to show me what you can do.