The analyses of a text #2

The protagonist, Philip now works as a shop-walker at a lingerie store.

........................................
This was Mrs. Hodges, a little woman of five-and-forty, with badly dyed hair; she had a yellow face with a network of small red veins all over it, and yellow whites to her pale blue eyes. She took a fancy to Philip and called him by his Christian name before he had been in the shop a week.
"We've both known what it is to come down," she said.
She told Philip that her real name was not Hodges, but she always referred to 'me 'usband Misterodges;" he was a barrister and he treated her simply shocking, so she left him as she preferred to be independent like; but she had known what it was to drive in her own carriage, dear-she called everyone dear-and they always had late dinner at home. She used to pick her teeth with the pin of an enormous silver brooch. It was in the form of a whip and a hunting-crop crossed, with two spurs in the middle.
[Of Human Bondage by Somerset Maugham]
1. I'd like to know what "come down something" means.
2. I'd like to know what "referred to 'me 'usband Misterodges" means
Thank you in advance for your help.