I think most of the time is correct in the sentence you have given. " And most of the time refers to specific period of time as is the case in your sentence.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.