It's ambiguous, and sounds like you are saying he's not very smart. Can you not simply say "He has no authority on this issue" or "It's not his decision to make" and be clear?
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.