If I'm not mistaken, "believe on" is archaic. I think it's used in the King James bible. Generally we skip the preposition to say we believe something is true.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.