#3 either refers to a church that the speaker does not know (or that the speaker assumes the listener does not know), or it could be the speaker does not consider it important to specify which church it was. #4 is fine, it indicates the church that he attends (or he's the pastor).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.