"a little of the book" can be interpreted as "a little of what's written in the book" so you're referring to a part of the book's contents. "few" and "a few" work only with multiple items. When you thinking of a part of something it's always (a) little and much.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.