No, it is not wrong. In the present, it means from what I have come to understand. In the past, the information is what I had come to understand.
From what I gather, the weather will be tonight. From what I gathered (in some previous conversation probably), he was still mad. Or from what I gathered, he is still mad.