This is one of those tricky things that native English speakers have difficulty explaining. I found a couple websites explaining the difference between the two, and I've included links to them on my blog here (see the links under "Infinitive"). Hope those help!
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.