I would interpret these quite differently. 1 and 4 mean that he kept claiming he was innocent up to the moment he was killed. 2 and 3 (to me) suggest that as his execution was about to happen, he finally admitted his guilt.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.