The sentence is in past tense ("By the time he was eighteen"). Hence the correct verb form is "began."
"Begins" is present tense (wrong), "started beginning" is awkward and redundant, "would begin" implies future in the past, which is not intended here.
\[
\Rightarrow \boxed{\text{began}}
\]