"It is difficult" is followed by a FOR ... TO ... structure. The FOR ... part, which contains a noun phrase or pronoun, may be omitted. The FOR ... part does not contain a verb. The TO... part contains a verb. In this structure the verb following TO is never inflected with "-ing".
It is difficult for me to understand English. It is difficult to underst