"On the job" is the usual, idiomatic way of saying "doing my job". "In the job" is not idiomatic and always sounds wrong. You can also be "on a job", if your job consists of individual "jobs".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.