Neither of the statements are correct. You want to say "Do you think I speak poor English", or "Do you think my English is poor"? You can also supplement the word "poor" with "bad", "awful", etc.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.