Does "agent" refer to "me"?

Context:

We are told that the active clause "I will always remember my first trip to Boston" sounds much better than the corresponding passive "My first visit to Boston will always be remembered by me." It sure does. But that's because a passive is always a stylistic train wreck when the subject refers to something newer and less established in the discourse than the agent (the noun phrase that follows "by").