No. "that which" must not be replaced by either "that" or "which". Both words are required. "that" is the antecedent and "which" is the relative pronoun which refers back to "that".
It is similar to this: We should not try to give great importance to that (thing) which we cannot understand.