would have

We hadn't thought they would have come this far.(in reality they came this far) Is this correct? Can we use simple past with the first 'we didn't think.....'?

Please help here.