It's a correct, conditional sentence. If I was bothering them, they could have said something to me. (" could is less likely here) The second differs from the first in that it depicts a counter-factual past event whereas the first describes a past situation that hasn't yet been verified.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.