Hi. The right preposition for concern is about in that context, so you had better say We should be concerned about our appearance. In the context you cited, singular should be used, this has nothing to do with being countable or uncountable.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.