I have no way of knowing the source of his anger. Was she defending Robert, the person he blames for his troubles? It's impossible to know what has made him angry.
A side note: The verb is "to rage" not "to rag." To rag is an informal verb meaning to make fun of. His friends ragged on him for saying he had to go home early to his wife
If you are extremely angry at one person, and another person comes to talk to you, it's possible you will show your anger to that other person, even though the second person is not the one who made you mad.
It's impossible to know from this one sentence whether he is mad at her or if she was the person with the bad luck to find