Yes! You can use either off or from. The term off is used to indicate from an elevated point such as in: He jumps off the bridge. The term from is used to indicate an origin. Of course, you can also use out of, as in: he jumps out of the bed.
Please note that jump off also has another meaning, to set o