No, you can't say "I have trouble to speak English". You can say "I find it difficult to speak English". This is equivalent to "I find English difficult to speak ".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.