We use 'tall' mostly for people, trees, buildings with many floors, and a few other things which are higher than they are wide (e.g. factory chimneys or electricity pylons). Example: I'd like something cool to drink in a tall glass.
In other cases we usually prefer 'high': Mount Elbruz is the highest mountain in Europe