As illogical as it may seem, "story" works better. It may just "be the way we say it". "He lives on the fifth floor" sounds better than 'on the fifth story'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.