Neither. You do not want the possessive, you want the plural. If your surname is 'Griffith' it should be 'The Griffiths'; if your surname is 'Griffiths', it should be 'The Griffithses' (I know the latter looks awkward, but it is correct-- apostrophes are best saved only for possessives).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.