I wouldn't call it ellipsis. Well, at least not where you place it! I think you may have got the wrong end of stick in assigning a meaning to the word "then" in "and then only in the most tangential way".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.