It's: You are I are going to town. (correct) In informal English, in most dialects, especially in spoken English, you can also say: Me and you are going to town. You and me are going to town doesn't seem to be common compared to the other versions, so I wouldn't suggest it.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.