I don't think there is an exact reason why we use the past participle to form the perfect tenses. It's just that English works that way. It's just the definition of what a perfect tense is!
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.