Quite similar, and both could be used in the same situation, but to me the first (infinitive) form suggests a specific occasion while the second ( -ing ) form suggests a general or ongoing fear. I seem to recall a similar discussion on an old thread, which someone may be able to resurrect.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.