I would think that in the days when regiments were numbered he would have said he was from the 11th of Foot, or just the 11th Foot.
When they were named rather than numbered, he would have referred to them as the Devonshire Regiment, or just the Devonshires (they weren't actually named the North Devonshires).