I think you're looking for the idiom "come back to bite me". Usually that's used when someone does something negative, not when someone helps. Here's a typical use.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.