Hi MG; The sentence is grammatically correct, but the idiomatic meaning (you don't have to wear a tie where we are going; you can take it off) has been lost. To me it means your tie is missing, and you wish you had lost it in the room, because perhaps, it would be easier to find or recover.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.