I want to know if "talk you later" and "talk to you later" are both correct.
They are not both correct. It's talk to you later. It's like saying "Good-bye". It's so common that it can be seen in abbreviated form at the end of other kinds of communications as well. (See below.)