You don't need any preposition, but if you want one, use on . Use these: I was not at home that evening. < preferable I was not at home on that evening.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.