In this type of sentence, with the phrase "at the time," one could look at it as an example of ellipsis, which is very common in English (if something just doesn't seem to make any sense at all in English, it is often because words have been left out and are to be understood from the context or from the tradition of usage). For example:
He tried to cross the street but could not, becaus
'At the times' is not a collocated phrase, though the words can appear in such limited situations as Anon as illustrated. It does not mean 'at the time' or 'at the moment'.
At the time = at the same time At the moment = right now; currently and temporarily