Hi, Lenka, They both work. I think "of" is more common. " With "wide off the mark," I think the prepositional phrase answers the question "where," and "wide" is adjectival, modifying the prepositional phrase.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.