There is no difference in what they mean. The 2nd one normally requires further context indicating another past event which happened while you were using the pen.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.