You look up a word in a dictionary, meaning you find the entry and discover the meaning. However, if you were searching for the entry (perhaps because you were unsure of the spelling) you could say you were looking for it. In this sense you wouldn't look into the word in the dictionary, although you might look it up in order to look into the various meanings or the etymology.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.