It's possible I guess, but it doesn't seem tremendously natural. I think it would usually be said another way -- for example "Don't ask me for an opinion" or "Don't ask me what I think" (I assume it is intended to mean this kind of thing).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
spArkLOIf someone is asking me to tell something about him/her or simply asking views on him/her, then is it correct?No. See the previous answer. Don't ask me for my opinion.