Your first sentence is in the present progressive tense. You are talking about an event that has happened in the past and will probably happen in the future so the -ing suffix is correct. However, "You don't care to visiting me" is in the present (or possibly future, depending on the context of the sentence) tense and therefore needs to have a matching verb.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.