I think it's because the verb agrees with "all I wanted", and for some reason that needs a singular verb. However, sometimes you might find that someone also uses a plural verb if a plural noun follows: All I needed was/were two speakers.
I don't have any technical explanations to give you though.