You have, essentially, answered your own question. What is known as the ground floor, in many places, is exactly that, while the first floor is the one immediately above. Go with what is common in your area and let other travelers adapt.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.