Yes but you still need of to make that sentence make sense, grammar-wise. Of all the places he could have sat, he had to sit here. If you're referring to seats then I'd say Of all the seats he could have taken, he had to take this one here.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.