Your second guess is pretty much correct. It just means that the person speaking has been in New York at some previous time, and now they are there once more. By phrasing it this way they are implying that they either live in New York or spend a great deal of time there.