This is a comparative structure. Consider: He's twice as rich as his neighbour. So the one above is saying: There are (at most) (only) twice as many of them as there are of us.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.