Greetings, easy can function as an adverb, no doubt. The dictionaries are unanimous as to your question - take it easy features an adverb. Some other expressions with the word include easy does it; easy come, easy go, etc.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.