In the US, you'd say something along the lines of, "I dress very conservatively: white dress shirt, black pants, white socks, and black shoes." The phrase, "dress classically", is not used in the US today.
As a non-American, I know that some Americans wear white socks with that kind of outfit. But I've never hear it described as 'conservative' before. Far from it!