I would say that ancient Rome is the correct form (except in titles and at the start of a sentence), since the city has always had the name "Rome". "
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.