What does 'that' refer to?

"Duke wanted Sophia Loren in the picture so we'd have plenty of sex appeal, and we chose another Italian, Rossano Brazzi, a good but uninteresting actor who had become an international star in South Pacific. So with Loren, Brazzi, and Wayne, I had my three characters. And that's pretty much all I wanted in the film – just these three people. But Wayne wanted more to it, so we added the early scenes involving a bazaar and crowds, and I felt it all got too messy.

Q1) Does "that" refer to "these three people"?

I think 'that" doesn't seem to refer to "these three people". is "that" referring to the group to which the three people belong?

Q2) I'm curious to know what "there three people" is referred to as. that or all?