There are no rules, Easy. A good grammar book should have lists of the verbs that only take the infinitive or the -ing form and of those that take both (with either changed or unchanged meaning).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.