I have talked with most of them = no reference at all to time, frquency or how many of them together.
I have talked with most of them at one time or another = indicates that we are talking about a number of occasions, quite possibly one person at a time.