I'd say I usually hear the question phrased as "How many [people are] in your party?"
The idea that someone would question why the person finding them a table would have a need to know how many people were going to sit at that table is pretty unimaginable to me, as Clive indicates. If you had to ask that, I'd wonder whether it was okay that you were out without a minder.