Both are awkward in that they leave us unsure of whether it is the book or the office that is 'yours'. The comma does not help to solve this dilemma, but there should be no comma because the book is defined by the relative clause.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.