In ‘reported speech’, the word ‘that’ allows you to repeat what the person said almost unchanged. If instead, you were the recipient of the original comment, you might use, “He told me that to attend…” If you are uncomfortable with the harshness of the word “that”, you might instead use, “To attend the sermon, he told me he would go to …” or “To attend the sermon, he said he would go to …”
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.