Geoffrey Hinton

Geoffrey Everest Hinton (born 1947) is a British-Canadian computer scientist, cognitive scientist, and cognitive psychologist known for his work on artificial neural networks, which earned him the title "the Godfather of AI".

Hinton is University Professor Emeritus at the University of Toronto. From 2013 to 2023, he divided his time working for Google (Google Brain) and the University of Toronto before publicly announcing his departure from Google in May 2023, citing concerns about the many risks of artificial intelligence (AI) technology. In 2017, he co-founded and became the chief scientific advisor of the Vector Institute in Toronto.

With David Rumelhart and Ronald J. Williams, Hinton was co-author of a highly cited paper published in 1986 that popularised the backpropagation algorithm for training multi-layer neural networks, although they were not the first to propose the approach. Hinton is viewed as a leading figure in the deep learning community. The image-recognition milestone of the AlexNet designed in collaboration with his students Alex Krizhevsky and Ilya Sutskever for the ImageNet challenge 2012 was a breakthrough in the field of computer vision.

Hinton received the 2018 Turing Award, often referred to as the " Nobel Prize of Computing", together with Yoshua Bengio and Yann LeCun for their work on deep learning. They are sometimes referred to as the "Godfathers of Deep Learning" and have continued to give public talks together. He was also awarded, along with John Hopfield, the 2024 Nobel Prize in Physics for .

In May 2023, Hinton announced his resignation from Google to be able to "freely speak out about the risks of A.I." He has voiced concerns about deliberate misuse by malicious actors, technological unemployment, and existential risk from artificial general intelligence. He noted that establishing safety guidelines will require cooperation among those competing in use of AI in order to avoid the worst outcomes. After receiving the Nobel Prize, he called for urgent research into AI safety to figure out how to control AI systems smarter than humans.

Education

Hinton was born on 6 December 1947 in Wimbledon, England, and was educated at Clifton College in Bristol. In 1967, he enrolled as an undergraduate student at King's College, Cambridge, and after repeatedly switching between different fields, like natural sciences, history of art, and philosophy, he eventually graduated with a Bachelor of Arts degree in experimental psychology at the University of Cambridge in 1970.Curriculum Vitae Geoffrey E. Hinton
- website of the Department of Computer Science at the University of Toronto He spent a year apprenticing carpentry before returning to academic studies. From 1972 to 1975, he continued his study at the University of Edinburgh, where he was awarded a PhD in artificial intelligence in 1978 for research supervised by Christopher Longuet-Higgins, who favored the symbolic AI approach over the neural network approach.

Career and research

After his PhD, Hinton initially worked at the University of Sussex and at the MRC Applied Psychology Unit. After having difficulty getting funding in Britain, he worked in the US at the University of California, San Diego and Carnegie Mellon University. He was the founding director of the Gatsby Charitable Foundation Computational Neuroscience Unit at University College London. He University Professor Emeritus in the computer science department at the University of Toronto, where he has been affiliated since 1987.

Upon arrival in Canada, Geoffrey Hinton was appointed at the Canadian Institute for Advanced Research (CIFAR) in 1987 as a Fellow in CIFAR's first research program, Artificial Intelligence, Robotics & Society. In 2004, Hinton and collaborators successfully proposed the launch of a new program at CIFAR, "Neural Computation and Adaptive Perception" (NCAP), which today is named "Learning in Machines & Brains". Hinton would go on to lead NCAP for ten years. Among the members of the program are Yoshua Bengio and Yann LeCun, with whom Hinton would go on to win the ACM A.M. Turing Award in 2018. All three Turing winners continue to be members of the CIFAR Learning in Machines & Brains program.

Hinton taught a free online course on Neural Networks on the education platform Coursera in 2012. He co-founded DNNresearch Inc. in 2012 with his two graduate students Alex Krizhevsky and Ilya Sutskever at the University of Toronto’s department of computer science. In March 2013, Google acquired DNNresearch Inc., and Hinton planned to "divide his time between his university research and his work at Google".

Hinton's research concerns ways of using neural networks for machine learning, memory, perception, and symbol processing. He has written or co-written more than 200 peer-reviewed publications.

While Hinton was a postdoc at UC San Diego, David E. Rumelhart and Hinton and Ronald J. Williams applied the backpropagation algorithm to multi-layer neural networks. Their experiments showed that such networks can learn useful internal representations of data. In a 2018 interview, Hinton said that " David E. Rumelhart came up with the basic idea of backpropagation, so it's his invention". Although this work was important in popularising backpropagation, it was not the first to suggest the approach. Reverse-mode automatic differentiation, of which backpropagation is a special case, was proposed by Seppo Linnainmaa in 1970, and Paul Werbos proposed to use it to train neural networks in 1974.

In 1985, Hinton co-invented Boltzmann machines with David Ackley and Terry Sejnowski. His other contributions to neural network research include distributed representations, time delay neural network, mixtures of experts, Helmholtz machines and product of experts. An accessible introduction to Geoffrey Hinton's research can be found in his articles in ''Scientific American'' in September 1992 and October 1993. In 2007, Hinton coauthored an unsupervised learning paper titled ''Unsupervised learning of image transformations''. In 2008, he developed the visualization method t-SNE with Laurens van der Maaten.

In October and November 2017, Hinton published two open access research papers on the theme of capsule neural networks, which, according to Hinton, are "finally something that works well".

At the 2022 Conference on Neural Information Processing Systems (NeurIPS), Hinton introduced a new learning algorithm for neural networks that he calls the "Forward-Forward" algorithm. The idea of the new algorithm is to replace the traditional forward-backward passes of backpropagation with two forward passes, one with positive (i.e. real) data and the other with negative data that could be generated solely by the network.

In May 2023, Hinton publicly announced his resignation from Google. He explained his decision by saying that he wanted to "freely speak out about the risks of A.I." and added that a part of him now regrets his life's work.

Notable former PhD students and postdoctoral researchers from his group include Peter Dayan, Sam Roweis, Max Welling, Richard Zemel, Brendan Frey, Radford M. Neal, Yee Whye Teh, Ruslan Salakhutdinov, Ilya Sutskever, Yann LeCun, Alex Graves, Zoubin Ghahramani, and Peter Fitzhugh Brown.

Honours and awards

Hinton is a Fellow of the US Association for the Advancement of Artificial Intelligence (FAAAI) since 1990. He was elected a Fellow of the Royal Society of Canada (FRSC) in 1996, and then a Fellow of the Royal Society of London (FRS) in 1998. One or more of the preceding sentences incorporates text from the royalsociety.org website where: He was the first winner of the Rumelhart Prize in 2001. His certificate of election for the Royal Society reads:

In 2001, Hinton was awarded an honorary Doctor of Science (DSc) degree from the University of Edinburgh. He was awarded as International Honorary Member of the American Academy of Arts and Sciences in 2003. Also, in this year he was elected a Fellow of the US Cognitive Science Society. He was the 2005 recipient of the IJCAI Award for Research Excellence lifetime-achievement award. He was awarded the 2011 Herzberg Canada Gold Medal for Science and Engineering. In that same year, he also was awarded an honorary DSc degree from the University of Sussex In 2012, he received the Canada Council Killam Prize in Engineering. In 2013, he was awarded an honorary doctorate from the Université de Sherbrooke. Hinton was elected an Honorary Foreign Member of the Spanish Royal Academy of Engineering in 2015.

In 2016, Hinton was elected an International Member of the US National Academy of Engineering "for contributions to the theory and practice of artificial neural networks and their application to speech recognition and computer vision". He received the 2016 IEEE/RSE Wolfson James Clerk Maxwell Award. In 2016, he furthermore won the BBVA Foundation Frontiers of Knowledge Award in the Information and Communication Technologies category, "for his pioneering and highly influential work" to endow machines with the ability to learn.

Together with Yann LeCun, and Yoshua Bengio, Hinton won the 2018 Turing Award for conceptual and engineering breakthroughs that have made deep neural networks a critical component of computing. Also in 2018, he became a Companion of the Order of Canada (CC).
In 2021, he received the Dickson Prize in Science from the Carnegie Mellon University and in 2022 the Princess of Asturias Award in the Scientific Research category, along with Yann LeCun, Yoshua Bengio, and Demis Hassabis. In the same year, Hinton received an Honorary DSc degree from the University of Toronto. In 2023, he was named an ACM Fellow, elected an International Member of the US National Academy of Sciences, and received Lifeboat Foundation's 2023 Guardian Award along with Ilya Sutskever. In 2023, he was named a Highly Ranked Scholar by ScholarGPS for both lifetime and prior five years.

In 2024, he was jointly awarded the Nobel Prize in Physics with John Hopfield "for foundational discoveries and inventions that enable machine learning with artificial neural networks." His development of the Boltzmann machine was explicitly mentioned in the citation. When the ''New York Times'' reporter Cade Metz asked Hinton to explain in simpler terms how the Boltzmann machine could "pretrain" backpropagation networks, Hinton quipped that Richard Feynman reportedly said: "Listen, buddy, if I could explain it in a couple of minutes, it wouldn't be worth the Nobel Prize." That same year, he received the VinFuture Prize grand award alongside Yoshua Bengio, Yann LeCun, Jen-Hsun Huang, and Fei-Fei Li for groundbreaking contributions to neural networks and deep learning algorithms.

In 2025 he was awarded the Queen Elizabeth Prize for Engineering jointly with Yoshua Bengio, Bill Dally, John Hopfield, Yann LeCun, Jen-Hsun Huang and Fei-Fei Li.

Views

Risks of artificial intelligence

In 2023, Hinton expressed concerns about the rapid progress of AI. He had previously believed that artificial general intelligence (AGI) was "30 to 50 years or even longer away." However, in a March 2023 interview with CBS, he said that "general-purpose AI" might be fewer than 20 years away and could bring about changes "comparable in scale with the industrial revolution or electricity."

In an interview with ''The New York Times'' published on 1 May 2023, Hinton announced his resignation from Google so he could "talk about the dangers of AI without considering how this impacts Google." He noted that "a part of him now regrets his life's work".

In early May 2023, Hinton said in an interview with BBC that AI might soon surpass the information capacity of the human brain. He described some of the risks posed by these chatbots as "quite scary". Hinton explained that chatbots have the ability to learn independently and share knowledge, so that whenever one copy acquires new information, it is automatically disseminated to the entire group, allowing AI chatbots to have the capability to accumulate knowledge far beyond the capacity of any individual. In 2025, he said "My greatest fear is that, in the long run, it'll turn out that these kind of digital beings we're creating are just a better form of intelligence than people. €¦We'd no longer be needed. €¦If you want to know how it's like not to be the apex intelligence, ask a chicken.

Existential risk from AGI

Hinton has expressed concerns about the possibility of an AI takeover, stating that "it's not inconceivable" that Existential risk from artificial general intelligence, AI could "wipe out humanity". Hinton said in 2023 that AI systems capable of Intelligent agent, intelligent agency would be useful for military or economic purposes. He worries that generally intelligent AI systems could "create sub-goals" that are AI alignment, unaligned with their programmers' interests. He says that AI systems may become AI alignment#Power-seeking and instrumental strategies, power-seeking or prevent themselves from being shut off, not because programmers intended them to, but because those sub-goals are Instrumental convergence, useful for achieving later goals. In particular, Hinton says "we have to think hard about how to control" AI systems capable of Intelligence explosion, self-improvement.

Catastrophic misuse

Hinton reports concerns about deliberate misuse of AI by malicious actors, stating that "it is hard to see how you can prevent the bad actors from using [AI] for bad things." In 2017, Hinton called for an international ban on lethal autonomous weapons.

Economic impacts

Hinton was previously optimistic about the economic effects of AI, noting in 2018 that: "The phrase 'artificial general intelligence' carries with it the implication that this sort of single robot is suddenly going to be smarter than you. I don't think it's going to be that. I think more and more of the routine things we do are going to be replaced by AI systems." Hinton had also argued that AGI would not make humans redundant: "[AI in the future is] going to know a lot about what you're probably going to want to do... But it's not going to replace you."

In 2023, however, Hinton became "worried that AI technologies will in time upend the job market" and Technological unemployment, take away more than just "drudge work". He said in 2024 that the British government would have to establish a universal basic income to deal with the impact of AI on inequality. In Hinton's view, AI will boost productivity and generate more wealth. But unless the government intervenes, it will only make the rich richer and hurt the people who might lose their jobs. "That's going to be very bad for society," he said.

At Christmas 2024 he had become somewhat more pessimistic, saying that there was a "10 to 20 per cent chance" that AI would be the cause of human extinction within the following three decades (he had previously suggested a 10% chance, without a timescale). He expressed surprise at the speed with which AI was advancing, and said that most experts expected AI to advance, probably in the next 20 years, to be "smarter than people ... a scary thought. ... So just leaving it to the profit motive of large companies is not going to be sufficient to make sure they develop it safely. The only thing that can force those big companies to do more research on safety is government regulation." Another "godfather of AI", Yann LeCun, disagreed, saying AI "could actually save humanity from extinction".

Politics

Hinton is a socialism, socialist. He moved from the US to Canada in part due to disillusionment with Ronald Reagan–era politics and disapproval of military funding of artificial intelligence.

In August 2024, Hinton co-authored a letter with Yoshua Bengio, Stuart J. Russell, Stuart Russell, and Lawrence Lessig in support of SB 1047, a California AI safety bill that would require companies training models which cost more than US$100 million to perform risk assessments before deployment. They said the legislation was the "bare minimum for effective regulation of this technology."

Personal life

Hinton's first wife, Rosalind Zalin, died of ovarian cancer in 1994; his second wife, Jacqueline "Jackie" Ford, died of pancreatic cancer in 2018.

Hinton is the great-great-grandson of the mathematician and educator Mary Everest Boole and her husband, the logician George Boole. George Boole's work eventually became one of the foundations of modern computer science. Another great-great-grandfather of his was the surgeon and author James Hinton (surgeon), James Hinton, who was the father of the mathematician Charles Howard Hinton.

Hinton's father was the Entomology, entomologist H. E. Hinton, Howard Hinton. His middle name comes from another relative, George Everest, the Surveyor General of India after whom the Mount Everest, mountain is named. He is the nephew of the economist Colin Clark (economist), Colin Clark.

Hinton injured his back at age 19, which makes sitting painful for him. He has dealt with depression throughout his life.

References

Further reading

* Joshua Rothman, Rothman, Joshua, "Metamorphosis: The godfather of A.I. thinks it's actually intelligent – and that scares him", ''The New Yorker'', 20 November 2023, pp. 29–39.

{{DEFAULTSORT:Hinton, Geoffrey
Artificial intelligence researchers
British computer scientists
British socialists
Canadian computer scientists
Canadian Nobel laureates
Canadian socialists
Nobel laureates in Physics
Companions of the Order of Canada
Fellows of the Association for the Advancement of Artificial Intelligence
2023 fellows of the Association for Computing Machinery
Fellows of the Royal Society
Google employees
Living people
Machine learning researchers
Academic staff of the University of Toronto
Canada Research Chairs
1947 births
Carnegie Mellon University faculty
Rumelhart Prize laureates
Alumni of King's College, Cambridge
Alumni of the University of Edinburgh
Fellows of the Cognitive Science Society
Turing Award laureates
People from Wimbledon, London
Foreign associates of the National Academy of Engineering
Hinton family
Canadian fellows of the Royal Society
People educated at Clifton College