It's just a less direct way of saying "I don't know". There is no explicit conditional sense -- just a vaguely implied "I wouldn't know ... if I was asked / if I had to give an opinion / etc.".
"would" can be used like this in lots of scenarios. Another example: "You wouldn't have a pen I could borrow, would you?" (polite).