It sounds odd. You can say "We stood together" or "We stood side by side". Both these, as well as the use of "to" (= "in order to"), draw special attention to the arrangement.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.