Come down = come. 'Down' may indicate an actual physical descent (as from a hilltop), or it may merely indicate a locally accepted conceptual direction (as 'downtown').
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.