Both are correct; the second refers to the house, and the first refers to the family within. Since both are acceptable, I would avoid the apostrophe-- it will just look like a smear of dirt.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.