From the two I would say "afraid" because anxiety is quite strong. Although I think maybe both are very strong emotions, I would probably say "worried".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.