There is a small difference. Argue over - usually the object is near at hand, or the decision must be made soon. Argue about - you can argue about something anytime.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.