I think it is necessarily adverbial, modifying 'attend'. Consider that it can be rearranged: Tomorrow morning, I have to attend a meeting. And it cannot pre-modify as it stands, but must be converted to possessive: I have to attend tomorrow morning's meeting.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.