Time phrases are irrelevant. Past perfect is used to relate two different past times. If the precedence of these two times is already clear, then simple past is sufficient unless stress is meant to be laid on this precedence.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.