🧠

Geoffrey Hinton

Original nameGeoffrey Hinton

British-Canadian Computer Scientist, "Godfather of AI," Core Driver of the Deep Learning Revival

Those Who Lit a New Era · Pioneers

The Backpropagation AlgorithmThe Deep Learning RevivalThe 2024 Nobel Prize in Physics

Who they are

Geoffrey Hinton (1947– ) is a British-Canadian computer scientist and cognitive psychologist who in 1986, with Rumelhart and Williams, co-authored a paper systematically expounding the application of the "backpropagation algorithm" to the training of multi-layer neural networks, and this method of adjusting network weights by passing error gradients backward layer by layer thereafter became the core mechanism of the training of almost all deep neural networks. In the decades-long "neural network winter," when the mainstream field had largely turned to other technical paths, Hinton held always to the neural-network direction, publishing in 2006 papers on "deep belief networks" that found a more effective way to initialize the multi-layer training of neural networks, widely seen as the starting point of the "deep learning revival." In 2012, the "AlexNet" he designed with two graduate students, Alex Krizhevsky and Ilya Sutskever, won the ImageNet image-recognition competition by an enormous margin over the runner-up, the first time deep learning proved its overwhelming advantage over the earlier mainstream methods in an authoritative public competition, thereafter triggering the whole field of AI to turn collectively to deep learning. For these foundational contributions Hinton, with Bengio and LeCun, won in 2018 the Turing Award, known as the "Nobel Prize of computing," and in 2024 further won the Nobel Prize in Physics (shared with John Hopfield for their foundational research in machine learning with artificial neural networks). In 2023 he actively resigned his post at Google, frankly saying he resigned to be able to speak more freely about the possible long-term risks of AI technology, and has since continually called on all sectors of society to face these risks squarely.

Primary sourcesHinton, Rumelhart, Williams, "Learning Representations by Back-Propagating Errors" (1986)The 2024 Nobel Prize in Physics citation

Key stories

Perseverance in the Neural-Network Winter

From the late 1980s to the early 2000s, the AI field widely held that the neural-network technical path was hard to scale and limited in effect, and turned its research focus to other methods, but Hinton firmly believed multi-layer neural networks held potential not yet fully tapped, and in the long era called the "neural network winter" continued to work this then-unfavored direction; his 2006 research on deep belief networks was the key fruit of this perseverance, planting the seed for the later full revival of deep learning.

AlexNet: The Deep Network That Made Its Name in One Battle

In 2012, the deep convolutional neural network "AlexNet" designed by Hinton’s two graduate students Krizhevsky and Sutskever won the ImageNet image-recognition competition founded and hosted by Stanford’s Fei-Fei Li by an error rate nearly 11 percentage points lower than the runner-up, this stark advantage shaking the whole field of computer vision and machine learning, and within a few short years deep learning swiftly replaced the earlier mainstream methods to become the default technical path of almost all AI research and industrial application.

Version differences

The priority of the backpropagation algorithm is also discussed: the mathematical principle of this method had earlier been independently proposed by other researchers (such as Linnainmaa and Werbos), and the core contribution of Hinton’s team’s 1986 paper was clearly showing this method could let multi-layer neural networks learn useful internal representations, thereby winning it wide attention and application in AI.

Relationships

Mentor

🖼️Fei-Fei Li　AlexNet proved the overwhelming advantage of deep learning precisely on the ImageNet dataset and competition platform Fei-Fei Li founded

Disciple

🌀Ilya Sutskever　Sutskever was Hinton’s doctoral student at the University of Toronto, and AlexNet was completed by the two together with Krizhevsky 🧩Demis Hassabis　The deep-neural-network methodology of DeepMind’s later systems such as AlphaGo and AlphaFold is rooted in the deep-learning foundation Hinton laid

Ally

👁️Yann LeCun　Named with LeCun and Bengio the "three giants of deep learning," together winning the Turing Award in 2018 🔗Yoshua Bengio　Named with LeCun and Hinton the "three giants of deep learning," together winning the Turing Award in 2018

Echoes today

Below are how modern works borrow or reinterpret this name or story — not the original material. The two differ, so keep them apart.

Resigning from Google just to "speak freely"When Hinton resigned from Google in 2023 he said publicly the decision was to be able to speak freely about the potential risks of AI without the constraint of an employer’s interest, and this posture of "retiring after success and turning to warning" was thereafter widely reported and discussed by the media.

Appears in

The Explosion of Deep Learning and Generative AIPerseverance in the "Neural Network Winter" and the Shock of AlexNet

← Back to Figures