You can safely remove the that from that sentence. In fact, "that" would probably be considered incorrect in modern English as would some other constructions such as "regretted to be under" (in modern English this would be regretted being under), and so on.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.