Either of these is possible but on the construction site is the most natural. A site is perceived as an area which you enter on to, and when you are there you are on site.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.