Hi Anton, Before a native speaker voices her/his opinion, I'll tell you what I think if you don't mind. In this case I would choose the Past Simple tense, as I think that the sentence ("Mr. Smith called you and asked to call him back") does have a hidden "while you were out" reading, which states a definite time when the action took place (which is typical of the past simple).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.