Either is okay. You can say "I am coming to the party" or "I am going to the party". The former implies that the party is imminent, or that you are talking to the party's host.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.