Following on from that one could assume that that was true from the beginning. I'd say the expression is register neutral (neither exclusively casual nor formal). Of course we assume that prior context tells us what "that" is.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.