Actually, all four of those sentences are perfectly correct! I thought about writing a reply = I thought about writing a reply in the past, but now I have decided not to. I was thinking about writing a reply = I thought about writing a reply in the past, and I still haven't decided if I will or not.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.