Well, of course, if you know the time exactly, "at 10 o'clock in the evening" would be the best way to say it! Your other choices are good (1 and 2). Other possibilities don't immediately come to mind.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.