People who live in that mansion

The definite and indefinite articles are very difficult to us Japanese people, because our language (Japanese) does not have them.

I learned that "the" is necessary before "people" in the following sentence.
The people who live in that mansion will have bad luck. (Not people in general live there.)

However, I don't think that I should put "the" before "people" in the following case.

There is an old mansion near our apartment building.
Its ownership changed several times, but it is a well-maintained building.
Nobody, however, wants to live there now, because most folks around here know that people who live in that mansion will have bad luck.

Please tell me if my understanding is correct.