Saying "that doesn't speak to me" is pretty abstract and isn't used in everyday English, if at all. The first one makes sense. The second one should be "That doesn't mean anything to me, I've never been to this city before.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.