I don't think there is any difference at all. In the case of "much difference" the "of a" in between the two words are implied, making it synonymous to "much of a difference" .
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.