Both are fine. Use of the modal suggests the immediacy of the activity of changing offices, where the simple past suggests the accomplished fact. It is a perspective in the mind of the speaker/writer which does not normally or materially affect the message conveyed to the listener/reader.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.