Song lyrics are often not syntactically correct, but yes, the phrase is certainly adverbial in intent. There is no point in thinking what might or might not be 'omitted'. Different words give sentences different syntax - different ways of expressing the same thought.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.