look someone in the eye is a fixed phrase It will sound odd if you change it.
Here are some examples where 'at' should not be used.. I'm sure there are more. He looked happy. He looked for his keys. He looked from Tom to Mary. He looks about eighteen. I know where he looked.