I assume a colleague is saying this to you. "too early" emphasises that it is actually inconvenient or wrong for you arrive at that time. " (albeit not impossible) because "too" is more of an external judgement than something the person themselves can explain.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.