These are fine: Your indignation/ outrage hurts me than any other thing. Your aloofness/standoffishness hurts me than any other thing. outrage = irateness, anger outrageousness = immoderation, indecency.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.