If one person was doing something and the other wasn't, that's what we would say. If somebody said that both people were doing something, and we wished to say that that was not the case, we'd probably say "One of them isn't doing it" or "Only one of them is doing it. We could just about say "Both of them aren't doing it/ Both of them aren't doing it", but it's not very likely.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.