caught = seen, but the word caught indicates that his being seen in the company of Death Eaters was (somewhat or even completely) unexpected I'd = I would had to go = had to disappear in the sense it could not be associated with him
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.