Is This Sentence Also Right?

Neither my father nor I were there.

As far as I know, the sentence should be: Neither my father nor I was there.

But my grammar book insists the sentence is also right, saying that semantically, the sentence means both my father and I were not there.