As far as I can tell, "It's not that kind of like" means that he doesn't like her in the physical or sexual way that might otherwise be imagined. This wording would make more sense if the actual word "like" had been used previously, rather than "admire", and if quotes were placed around the word: "I like Victoria from f(x). " "If ...
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.