My understanding is that "colloquial" phrases are regional, or common to certain communities. That is, they're not generally used throughout the entire area that speaks AmE or BrE. This could also be said of a lot of slang expressions, but most slang is ubiquitous.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.