I'm not aware of a word that means to cry by reason of joy or happiness, so cry is your best bet. Both cry out of joy and cry from joy are correct. I would use the latter.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.