"Not exactly" tends to be half yes half no, there's a good feeling of being in the right direction. "Not really" makes for more of a strong no with a general feeling of being in the wrong direction. However, politeness and irony can change any rule.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.