"I didn't think this was a big problem and I set myself off to find another counter."
You can 'set yourself to perform a task', in the sense of cause yourself, start yourself, apply your mind. However, it's not a common phrase. It's also a bit literary in tone. No 'off' should