Learning academic English?

Hi!I'm a physics student,my goal is to read English physics papers and text books like native students also to understand video lectures on physics and contact other students and physicists to discuss and talk about the issues of physics,actually i want to learn listening,reading and writing(writing in both formal and informal way in order to contacting with others by writing)so learn to speak would not be as helpful as the other skills to me.
Naturally,a native American student starts learning the general English by just listening and maybe looking when he or she was a little kid,then tries to speak then his or her speaking skill grows,then starts reading and writing at the same time but first in the general English,and during his or her educational life in school and college,his or her language skills(listening,speaking,reading and writing) of both general and academic English improve.So should i learn the academic English like above,i mean should i start by just listening then speaking then reading and writing?Also should i start by the general English and after that The academic one?or could i learn both general and academic at the same time?
Please tell me what should i do to reach the goal i said perfectly and in minimum time?I'm also wondering to hear about your other points on the subject.

Sincerely,