1) Your extract is connecting the 'left him' with the wrong end of the sentence. It should be with the start of the sentence - The ease that never left him (even in such high places). It means that he was confident and felt at ease even in socially/politically 'high' places.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.