Hi there. This is a big area of grammar - there are lots and lots of rules for these, but here is a short answer. " is a perfect infinitive and wouldn't be used in the example you gave.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.