It depends on what you want to say. "A flaw of mine" means "one of my flaws", so it implies you have some others. I've never heard "the flaw of mine", but "that flaw of mine" refers to the "flaw of yours" you've just mentioned.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.