It doesn't really matter as a rule. It depends on what context the words taken aback are being used Taken aback can be followed by - about, with, by, to, at etc, depending on the rest of the sentence. e.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.