would is probably the most usual choice. People choose on the basis of matching tenses. told ... goes with would .... For the most part they tend to ignore any information about real time, so that explanation you gave about 3 o'clock and 2 o'clock doesn't influence their decision.