Hi, it seems strange to me. The opposite would be a noun, and diametrically is an adverb, and they can go together. After looking up "diametrically" in my dictionary, I think you can only use that expression if you use "opposite" as an adjective.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.