With scarf, we can say around our neck. But with glasses, I don't know how to construct the answer. Can you please check the following to see if they make sense and normal:
We wear glasses on our face We wear glasses over our eyes We wear glasses on our nose We wear glasses on our head