Yes, you are right. It refers to actual, physical steps like those on a ladder or stairs. They may be steps outside the pool on the route, or path, to the pool, or they may be steps in the pool used to walk into the pool.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.