If you want to avoid confusion either agree with the person or state your preference.
Yes, I agree, So do I, Yes, I do
or
I do not like apples, I like apples, Apples are good, (You are making a completely new statement that does not reference to what the previous person said.)