The speaker wants to emphasize the current status of the "going" - not a habitual action of present simple, but the situation right then, as it is occurring . In other words, he's inviting you to stop him immediately. You can use present simple if you wish, however.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.