Because, as it stands, the second question is incomplete.
1) Is this the classroom in which they studied last year? (question)
Yes, this is the classroom in which they studied last year.(answer)
2) Is the classroom in which they studied last year in this building? (This question is incomplete without the added part in bold)
No, the classroom in which the