Should I include the "had" for past tense?

Years before Targonne’s birth, his family had sold weapons to the dragonarmies of the Dark Queen during the War of the Lance, but they (had) switched sides when the goddess’s forces started to lose the conflict, and then purchased what little agricultural land there was in Neraka so that they would be the only ones who possessed grain and steel in the dark city.