It's grammatical, but not completely idiomatic. late at night is the expression, and just late is usually enough anyway. And you might change the last clause a bit.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.