I guess there would be no difference, although I have never heard the term "roof window" used. Of course, most English speakers would understand the concept--but I think the term "skylight" is almost universally used in this application. Yes, you would use it the same as "window" and it would be countable.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.