By, of, from?

What is the exact difference between:

"the book X by James"

"the boox X of James"

"the book X from James"?

Especially the words "from" and "of" irritate me in this context, it seems to me that the preposition "from" tells you this book "was taken" from a locus, while "of" relates to the possessive background of this book. Am I right?