"I can not go back to the past" is correct. I don't understand what you mean by "Not what I miss," or how it relates to the second part of the sentence.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.