"There's smoke coming out of that window." (There is one plume of smoke here.)
"There's smoke coming out of both windows." (There are two plumes of smoke coming out of the two windows, but the word is still "smoke," not "smokes.")
However, in American slang, "smoke" can mean cigarette, and this has a plural: