Yes, it is correct and common. 'Begin to write' and 'begin writing' are synonymous. Some verbs accept one form ( quit drinking ) and some verbs accept the other ( want to dance ) and some verbs take both, sometimes synonymously ( like to drink, like drinking ) and sometimes with different meanings ( remember to vote, remember voting ).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.