I believe the sexual idiom is 'to go down' on someone, Redkiddy, which is to have sexual intercourse. Slang, but not particularly obscene.
'To come down on' is usually, as you said, Mav, to blame aggressively or castigate for a perceived infraction. I think it can be expanded to mean 'verbally attack' in general.