I've certainly heard "We got rained on" in casual conversation. The metaphorical use (like "don't rain on my parade" - don't give me bad news about something I'm happy about) could easily use the passive.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.