It's possible, but it would normally have connotations of something more than just the physical construction of a building -- usually relating to an associated organisation or institution, as you say.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.