The library would refer to a specific library known to the person being addressed, such as the library of the college where John, the speaker, and the person spoken to, are students. A library would not convey any information about which library was meant. The library might be in a small town in Kansas where both John and the speaker happened to be one day.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.