I am not sure exactly what your question is. "on his birthday" = "when his birthday came" in this context. However, it looks clumsy to repeat "when his birthday came" in the same sentence.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.