Modal auxiliary verbs and adverbs have no special relationship. However, the modal auxiliary is usually the first unit of a verb phrase, and the usual position of many adverbs is immediately following the first unit of a verb phrase: I can never find him. I might seriously consider your offer.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.