Possessive 'of' + pronoun is not good style in any case. And your sentence has other problems. I suggest: When you are clocked in, hard work is to your and your colleagues' advantage.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.