It hardly matters. Both are in use. The Random House Unabridged Dictionary has no hyphen after multi in any word, but I think quite a few native speakers might prefer to use it.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.