It's not wrong, but it sounds a bit awkward, and unnatural, like something a lawyer might ask.. I suggest eg Was he probably there at that time? eg Was he probably there then?
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.