I don't believe that they are sets, Anon. We usually have to teach the difference between 'former/latter' and 'first/last'. 'Late' is of another use, and its antonym is 'early'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.