That's a bit awkward. Try: It' a good thing nobody was in a hurry while you were in the bathroom. [ I "see" the French in your original, and it's just one of those constructions that doesn't translate well.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.