I am absolutely flabbergasted that there are so few hits for the second form, and I can think of no reason why that should be. It is quite common in conversation, I am sure. 'Talk with' suggests a lengthier discussion than does 'talk to'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.