I'm not sure if I can use that idiom after positive and negative sentences as well.
- I'm sure we won. - Don't speak too soon. OK
- I'm afraid we have to sell the car. We ran out of the money. In terms of grammar, this is not really a negative sentence. It's just 'an unhappy sentence'.