0 Well, I'm not saying that "last evening" or even "yesterday night" are incorrect, they just sound unusual and awkward to me. My advice would be to stick to "yesterday evening" and "last night". If you want to sound very formal, you could even use "yestereve". 0-