'All' is not plural, it's a quantifier: 'all snow is white'; 'all penguins are black'. All (of) that jazz annoys me. All (of) those jazz musicians annoy me.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.