A travel agent works at a travel agency. I go to a travel agency to talk to a person who works in that office; he is a travel agent. As an answer to your question, I would say it implies both of your suggestions.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.