Nowadays, the most common expressions are probably ' Let's walk along the roadside / on the side of the road '— if that's what you mean. 'By the wayside' is rather restricted in my mind to the fiixed phrase 'to fall by the wayside' and it permutations, or as an adjective, as in a 'wayside diner'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.