According to my dictionary "police" occurs only in plural, the others have a singular and plural: army/armies, navy/navies, air force/air forces. So its indeed correct. However, I remember that I have read somewhere, that especially in AmE you may also find: The police has found the thieves.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
I hope your memory is incorrect.