I suppose that it is possible to say that jocularly, but it sounds a bit silly to me. '. 'You got me' usually indicates that your secret, often embarrassing, has been revealed, or that you have been tricked or dumbfounded.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.