We also use the expression "in your face" to suggest that something you'd rather not be aware of is intruding into your private space. Your face is your window to the world, literally and figuratively.
We also say, "I saw him in the/my window" more often than "I saw him at the window."