Beginning with either 'with' or 'whom' seems acceptable to me. I wouldn't say there is a clear rule that you have to begin with 'whom'. In fact, the kind of person who is careful to say 'whom' would probably also prefer not to end a sentence with a preposition.
In everyday English, two thoughts:
Most people, regardless of educational level, would say 'who', not 'wh