I suppose it has something to do with their etymology. The words "transfer" and "defer" come from the Latin "transferre" and "deferre", respectively. I guess most, if not all, verbs that had a double 'r' in their Latin infinitive counterparts take on the additional 'r' when the past tense is formed.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.