There are no 'exact differences'-- and this is true of most synonyms. I agree that 'rectify' is more formal, in that fewer of us say it than write it. 'Rectify' is often used of conduct, inequities, deficiencies and oversights (that is, human weaknesses and errors).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.