Is the use of "every day" with simple past tense correct? Yes.
He wrote to her every day. He swam every day. We took the bus to work every day. The workers were paid at the end of the day every day. We ate rice every day.
These (wrote, swam, ...) mean the same as used to write, used to swim, used to take, used to be (paid), a