Using 'that' in a sentence. When to leave it out?

In the below sentence do you think it is better with or without 'that'.

But, I was sure that we'd be safe enough on a Saturday afternoon, as long as we kept ourselves to ourselves.
Or
But, I was sure we'd be safe enough on a Saturday afternoon, as long as we kept ourselves to ourselves.

Thanks
Ryan