Interesting question. I would indeed not mix them, as semicolons are distinctly formal, while m-dashes are distinctly informal, but having said that, your example reads to me as if the semicolon did end the dashed phrase.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.