You can use declined in both sentences. If you'd rather use two different words, you could choose dwindled for the second sentence. These are just stylistic ideas; I don't know if you could say there are proper or improper words, except maybe the following: dwindle and diminish carry an idea of numerable objects, for example, people.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.