If it is a book, check with your editor. I think it is a style choice, since the cases that are otherwise confusing are often allowed to use apostrophes where they are strictly uncalled for, as in "mind your p's and q's".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.