" "made up of wood" is not actually incorrect, but it's less usual and has a stronger sense of "assembled from wood". In this sentence I'd wouldn't recommend it. Even though a bench is indeed "assembled" there's no particular need to emphasise this.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.