They aren't measurements rather they are clothing sizes- usually of trousers or jeans or dresses. The new part of the expression is that this size is treated like it is the other size. Hence Size 2 is treated like it is size four.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.