Hi Anon There is nothing wrong with saying " that was the first time" -- particularly if in the broader context you go on to describe another time the same thing happened. However, it is not restricted to that sort of usage. You cannot use "that" if you have not yet described or referred to the event.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.