Yes, you can say that even though I don't quite agree with your interpretation. Usually you use "stare at" when referring to people or tangible things whereas "stare into" is more common with ethereal things like distance, space, the sky etc. Sometimes both prepositions are possible (stare at/into the sky/Sun etc) But you may say to stare into her/his eyes ect
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.