Both are fine (if 'he' is still alive). In the first, the speaker is thinking of their ages now; in the second, the speaker is thinking of their ages when 'he' spoke.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.