I think if it's followed by a bare infinitive it's "part of the infinitive" but I suggest that you write the sentence you doubt and we will try to help you.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.