The more natural construction is: I have difficulty doing that exercise. Other ways to say the same thing: I find it difficult to do that exercise. Doing that exercise is difficult for me.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.