The actual subject is the whole NP the remainder of the population.
And my ear also tells me are.
Rule 8. With words that indicate portions—percent, fraction, part, majority, some, all, remainder, etc.—you must look at the object of the preposition to determine whether to use a singular or plural verb. If the object of the preposition is singular, use