The 'hours' are the hours when there are usually members of staff present. 'Out of hours' is any other time. So if an office is staffed between 8am and 6pm, 'out of hours' means the time between 6pm and 8am next morning.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.