Yes, I am afraid that the only explanation is 'idiom'. 'Night' is for some historical reason treated differently: Last night, yesterday morning, yesterday afternoon. At night, in the morning, in the afternoon.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
Vctory Ongis it because it's not idomatic to say last morning?