To a musician, yes. (the difference between unison and harmony)
Unity could mean we see eye to eye. (are in perfect agreement) Harmony could mean we make beautiful music together, each carrying his own part - both common expressions.
Will Rodgers used to say, "If you and I agree completely, then one of us is unnecessary."