If it is the first time you are referring to the Minisitry of Education you place the abbreviation in parenthesis after the full name. If you have previously done so in the document, you can simply refer to it thereafter as MOE. Thus, only your first sentence is correct.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.