These "symbols," as you call them, are punctuation known as quotation marks. They are an integral and important part of English grammar, style, and usage. Here is a link to an explanation of what they are, why they are used, and when to use them.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.