I would rephrase your sentence as follows (in American English): A4 paper is usually loaded into a printer widthwise. By the way, I'm not sure that's true. It's been my experience that most printers take A4 and similar size paper lengthwise.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.