I would say that there are some differences in usage, even though these words do have similar meanings. For example, while one could certainly say, "The last earthquake was so severe that the buildings trembled on their foundations," using "shivered" instead of "trembled" would seem quite strange (at least to me). A voice can also tremble with emotion, but not shiver.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.