Yes, but at present is slightly more formal. Currently is less formal.
Some examples of correct usages (all mean the same): 1. Currently we have no plans to build any more factories in China. 2. We have no plans to build any more factories in China at the moment. 3. We have no plans to build any more factories in China at the present moment. 4. At present