This is the "had to" of "obligation" but it's used here to express frustration that the person did it. You thought it was necessary to hear the jacket? " You could also say "am wearing" but the past tense refers back to the time when he made the choice to wear it.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.