Both with and without the accent mark are acceptable ways to write 'cafe'. I would assume that one main reason for not using the accent mark has to do with the simple fact that putting an accent mark over the letter 'e' is not easy to do on an English keyboard.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.