It's just a set phrase that is said to express exasperation. eg For crying out loud, I've lost my car keys again! A similar expression is For Pete's sake, ...
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.