Yes, 'governorship' is the job, like 'presidency'. It is an abstract noun. Use 'governor's office' for both: ' provincial governor's office ' and ' district governor's office ' would be clear, direct and natural.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.