She talks a lot in the classroom. 'In' is usual. Although you will see both prepositions used with many locational nouns (at/in the station/office/airport), I think that 'at the classroom' is very unusual.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.