Both are correct. If you want to convey the neutral fact that you drank milk, say I drank a glass of milk. If you want to emphasize how many glasses of milk you drank, say I drank one glass of milk.
a glass ... just says you drank milk one glass ... says how many glasses of milk -- Did you drink anything? -- Yes, I dr