Hi, Do you think they are interchangeable?No. Depending on the sentence, one may sound better than the other.
Can you say both "he takes offense at/to people calling him late"? Not really,in my opinion. These examples sound OK to me. "He takes offense to people calling him late" "He takes offense at people who call him late"