Need an answer to a riddle

"I am frequented by gossip, but when I’m four everyone listens.

I think a hot shave is the most decadent thing.

Hint: It's a place but in the wild west, it was often two or three."