In constructions such as this, the first amount is left out. I'll pay back (an amount that is) four times the amount. I think you realize that you're dealing with two amounts here and the first one is implicit.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.