'Always' doesn't work with so many exceptions (about 15-30%). And you don't need the first part. I suggest: He usually came home late at night drunken or penniless from gambling.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.