This American would opt for "were." If there were 400 people, "a great part of those people" would still refer to multiple people. The immigants (I'd use "im" since they have come to New York) are not a unit, functioning together, the way "a jury" or "a team" would - they are a great mass of people, so the plural verb makes far more sense.