Taken aback by such double effrontery he allowed me to stay. Is it saying that "I" am so bare-bone daring and thick skinned that my effrontery leaves him shake his head, just let me be.-- We have no idea about that, since we cannot see the text.
Then why double?-- There are presumably two instances of rudeness (or a compounded rudeness) that have been exhibited.