Yes, you need it there. And the sentence could be polished:
"The word 'xyz' is often used, although it is not common."
However, you could recast: by getting the modifier closer to the modified, the pronoun will not be necessary-- "Although not a common word, 'xyz' is often used."