I see no actual difference between 1 and 3. No. 2 is rarely used, but one of the meanings of on and upon is 'immediately after'. So sentence No. 2 means Immedialtely after he had finished the work he went to...
This meaning is more often see in other expressions. Here's one: