I'm not sure what your question is. If you are asking if the underlined part means "got rid of it", I would say it means "I left that town a long time ago. The expression here is obviously more visual and shows that the character has an agressive side to his personality.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.