No, it would have to be "I neither speak English nor am good at English", but it seems unnecessary to say both things since one implies the other. If you have a distinction in mind between speaking English and being good at English then it needs to be more clearly described.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.