No. There was no record of his youth means that we do not have written records of where he was born and what he did when he was young. There was no record in his youth is non-idiomatic and would imply that no one kept any records at all when he was young.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.