Think of the way waves come across the ocean to the beach. 'Wave upon wave' means 'many waves, after each other, following each other'.
Much depends on the context. You might be talking about real waves on the ocean. Or it might be 'The sick man felt wave after wave of pain'. Or it might be 'Wave a