” The verb “give back” (meaning return) is a phrasal verb. The direct object is “that book you borrowed”; and the indirect object is “me”. So, yes you can separate/split “give back” and you can shorten the object to “that book”.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.