Greetings, 'on THE one hand... one the other (hand)' is the correct alternative. Confusion arises chiefly because of the expression 'on (the) one side...
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.