I understand the thought process behind both versions. I assume this is part or a much larger story. The second version is grammatically correct, however as part of a story that tells about this person being in Atlanta in the past, and trying to put this experience (in text) across then the first is preferable to me.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.