The grammar does not work. Here are two options: She was not on the alert for a bad guy in a mask who was tracking her stealthily. She was not aware that a bad guy in a mask was tracking her stealthily.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.