That there is not critical for understanding, so it is not necessary. 'Every time when ' is not very good style, at least, and some will complain about its grammar. 'When you + verb every time' also contains redundancy-- 'When you + verb' is enough.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.