The second one is more natural. The first one implies that maybe they should have worked, but you expected them to be lazy & they were. The second one implies that you assumed it to be a day off.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.