The reason you need the adjective instead of the adverb is that you mean "He looks [as if he is ] horrible," not "he looks/watches in a horrible manner."
You would only use an adverb after "looks" if you were actually describing the manner of looking. ("When collecting seashells he looks very carelessly, so he doesn't find very many.")