Both people have the same living room in mind, yes.
When B says "in the living room", he knows there is only one living room in the neighborhood of A. That would have to be the living room being referred to.
Using the same reasoning, we say things like in the kitchen, in the refrigerator, on the porch,