It is used both ways, "a heavy rain" generally means one major downpour - all the rain coming at one time. "heavy rain" generally means periods of intense rain mixed with periods of calm or light rain.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.