That doesn't sound like the most natural way to use that phrase. Usually it means that you have missed an opportunity to do something, and/or also that a lot of other people share one opnion and you are not in agreement with them. You have missed the opportunity to align with those people to do something.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.