If you find Math difficult, then yes, you should say "Math is difficult for me" . I have virtually no doubt about that. About the second scenario (you find it easy, but think it's hard for others), I think that, if you say " Math is difficult to me", most people will not notice the difference between for and to , so they'll think you find Math hard.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
SurferHowever, if I find it easy myself (because, for example, I'm a professor of math) but still recognise its difficulty (for others for example) and view it as such, then I express my perception by saying:Math is difficult to me.Am I right on this?No