They commonly use "tall" when talking a vertical length of a standing thing and "high" when talking a thing's position above some base surface they have in mind. "Mount Chomolungma is the highest mountain in the world" means "The summit of Mount Chomolungma is the highest land position above the mean sea level". "The high lamp" means "the lamp is on a position high from the place the speaker stands".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.