|
Yudkowsky
Eliezer S. Yudkowsky ( ; born September 11, 1979) is an American artificial intelligence researcher and writer on decision theory and ethics, best known for popularizing ideas related to friendly artificial intelligence. He is the founder of and a research fellow at the Machine Intelligence Research Institute (MIRI), a private research nonprofit based in Berkeley, California. His work on the prospect of a runaway intelligence explosion influenced philosopher Nick Bostrom's 2014 book '' Superintelligence: Paths, Dangers, Strategies''. Work in artificial intelligence safety Goal learning and incentives in software systems Yudkowsky's views on the safety challenges future generations of AI systems pose are discussed in Stuart Russell's and Peter Norvig's undergraduate textbook '' Artificial Intelligence: A Modern Approach''. Noting the difficulty of formally specifying general-purpose goals by hand, Russell and Norvig cite Yudkowsky's proposal that autonomous and adaptive systems ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Harry Potter And The Methods Of Rationality
''Harry Potter and the Methods of Rationality'' (''HPMOR'') is a work of ''Harry Potter'' fan fiction by Eliezer Yudkowsky published on FanFiction.Net as a serial from February 28, 2010 to March 14, 2015, totaling 122 chapters and over 660,000 words. It adapts the story of ''Harry Potter'' to explain complex concepts in cognitive science, philosophy, and the scientific method. Yudkowsky's reimagining supposes that Harry's aunt Petunia Evans married an Oxford professor and homeschooled Harry in science and rational thinking, allowing Harry to enter the magical world with ideals from the Age of Enlightenment and an experimental spirit. The fan fiction spans one year, covering Harry's first year in Hogwarts. ''HPMOR'' has inspired other works of fan fiction, art, and poetry. HPMOR is connected to the contemporary rationalist community and is popular among rationalists and effective altruists. Plot In this fan fiction's alternate universe to the ''Harry Potter'' series, Lily Pot ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Intelligence Explosion
The technological singularity—or simply the singularity—is a hypothetical point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable consequences for human civilization. According to the most popular version of the singularity hypothesis, I. J. Good's #Intelligence explosion, intelligence explosion model of 1965, an upgradable intelligent agent could eventually enter a positive feedback loop of successive Recursive self-improvement, self-improvement cycles; more intelligent generations would appear more and more rapidly, causing a rapid increase ("explosion") in intelligence that culminates in a powerful superintelligence, far surpassing all human intelligence.Vinge, Vernor"The Coming Technological Singularity: How to Survive in the Post-Human Era", in ''Vision-21: Interdisciplinary Science and Engineering in the Era of Cyberspace'', G. A. Landis, ed., NASA Publication CP-10129, pp. 11–22, 1993. - "There may be developed ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Nate Soares
The Machine Intelligence Research Institute (MIRI), formerly the Singularity Institute for Artificial Intelligence (SIAI), is a non-profit research institute focused since 2005 on identifying and managing potential existential risks from artificial general intelligence. MIRI's work has focused on a friendly AI approach to system design and on predicting the rate of technology development. History In 2000, Eliezer Yudkowsky founded the Singularity Institute for Artificial Intelligence with funding from Brian and Sabine Atkins, with the purpose of accelerating the development of artificial intelligence (AI). However, Yudkowsky began to be concerned that AI systems developed in the future could become superintelligent and pose risks to humanity, and in 2005 the institute moved to Silicon Valley and began to focus on ways to identify and manage those risks, which were at the time largely ignored by scientists in the field. Starting in 2006, the Institute organized the Singularity ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
LessWrong
''LessWrong'' (also written ''Less Wrong'') is a community blog and Internet forum, forum focused on discussion of cognitive biases, philosophy, psychology, economics, rationality, and artificial intelligence, among other topics. It is associated with the rationalist community. Purpose LessWrong describes itself as an online forum and community aimed at improving human reasoning, rationality, and decision-making, with the goal of helping its users hold more accurate beliefs and achieve their personal objectives. The best known posts of ''LessWrong'' are "The Sequences", a series of essays which aim to describe how to avoid the typical failure modes of human reasoning with the goal of improving decision-making and the evaluation of evidence. One suggestion is the use of Bayes' theorem as a decision-making tool. There is also a focus on psychological barriers that prevent good decision-making, including fear conditioning and List of cognitive biases, cognitive biases that have be ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Friendly Artificial Intelligence
Friendly artificial intelligence (friendly AI or FAI) is hypothetical artificial general intelligence (AGI) that would have a positive (benign) effect on humanity or at least align with human interests such as fostering the improvement of the human species. It is a part of the ethics of artificial intelligence and is closely related to machine ethics. While machine ethics is concerned with how an artificially intelligent agent ''should'' behave, friendly artificial intelligence research is focused on how to practically bring about this behavior and ensuring it is adequately constrained. Etymology and usage The term was coined by Eliezer Yudkowsky, who is best known for popularizing the idea, to discuss superintelligent artificial agents that reliably implement human values. Stuart J. Russell and Peter Norvig's leading artificial intelligence textbook, '' Artificial Intelligence: A Modern Approach'', describes the idea: Yudkowsky (2008) goes into more detail about how to d ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Instrumental Convergence
Instrumental convergence is the hypothetical tendency for most sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals, even if their ultimate goals are quite different. More precisely, agents (beings with agency) may pursue instrumental goals—goals which are made in pursuit of some particular end, but are not the end goals themselves—without ceasing, provided that their ultimate (intrinsic) goals may never be fully satisfied. Instrumental convergence posits that an intelligent agent with seemingly harmless but unbounded goals can act in surprisingly harmful ways. For example, a computer with the sole, unconstrained goal of solving a complex mathematics problem like the Riemann hypothesis could attempt to turn the entire Earth into one giant computer to increase its computational power so that it can succeed in its calculations. Proposed basic AI drives include utility function or goal-content integrity, self-protection, freedom from ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Superintelligence
A superintelligence is a hypothetical intelligent agent, agent that possesses intelligence surpassing that of the brightest and most intellectual giftedness, gifted human minds. "Superintelligence" may also refer to a property of advanced problem-solving systems that narrow AI, excel in specific areas (e.g., superintelligent Neural machine translation, language translators or engineering assistants). Nevertheless, a general purpose superintelligence remains hypothetical and its creation may or may not be triggered by an Technological singularity#Intelligence explosion, intelligence explosion or a technological singularity. University of Oxford philosopher Nick Bostrom defines ''superintelligence'' as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest". The program Fritz (chess), Fritz falls short of this conception of superintelligence—even though it is much better than humans at chess—because Fritz cannot outperform hum ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Nick Bostrom
Nick Bostrom ( ; ; born 10 March 1973) is a Philosophy, philosopher known for his work on existential risk, the anthropic principle, human enhancement ethics, whole brain emulation, Existential risk from artificial general intelligence, superintelligence risks, and the reversal test. He was the founding director of the now dissolved Future of Humanity Institute at the University of Oxford and is now Principal Researcher at the Macrostrategy Research Initiative. Bostrom is the author of ''Anthropic Bias: Observation Selection Effects in Science and Philosophy'' (2002), ''Superintelligence: Paths, Dangers, Strategies'' (2014) and ''Deep Utopia: Life and Meaning in a Solved World'' (2024). Bostrom believes that advances in artificial intelligence (AI) may lead to superintelligence, which he defines as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest". He views this as a major source of opportunities and existential risks ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
AI Alignment
In the field of artificial intelligence (AI), alignment aims to steer AI systems toward a person's or group's intended goals, preferences, or ethical principles. An AI system is considered ''aligned'' if it advances the intended objectives. A ''misaligned'' AI system pursues unintended objectives. It is often challenging for AI designers to align an AI system because it is difficult for them to specify the full range of desired and undesired behaviors. Therefore, AI designers often use simpler ''proxy goals'', such as Reinforcement learning from human feedback, gaining human approval. But proxy goals can overlook necessary constraints or reward the AI system for merely ''appearing'' aligned. AI systems may also find loopholes that allow them to accomplish their proxy goals efficiently but in unintended, sometimes harmful, ways (reward hacking). Advanced AI systems may develop unwanted Instrumental convergence, instrumental strategies, such as seeking power or survival because s ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Anthropomorphism
Anthropomorphism is the attribution of human traits, emotions, or intentions to non-human entities. It is considered to be an innate tendency of human psychology. Personification is the related attribution of human form and characteristics to abstract concepts such as nations, emotions, and natural forces, such as seasons and weather. Both have ancient roots as storytelling and artistic devices, and most cultures have traditional fables with anthropomorphized animals as characters. People have also routinely attributed human emotions and behavioral traits to wild as well as domesticated animals. Etymology Anthropomorphism and anthropomorphization derive from the verb form ''anthropomorphize'', itself derived from the Greek ''ánthrōpos'' (, "human") and ''morphē'' (, "form"). It is first attested in 1753, originally in reference to the heresy of applying a human form to the Christian God.''Oxford English Dictionary'', 1st ed. "anthropomorphism, ''n.''" Oxford University ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Future Of Humanity Institute
The Future of Humanity Institute (FHI) was an interdisciplinary research centre at the University of Oxford investigating big-picture questions about humanity and its prospects. It was founded in 2005 as part of the Faculty of Philosophy and the Oxford Martin School. Its director was philosopher Nick Bostrom, and its research staff included futurist Anders Sandberg and Giving What We Can founder Toby Ord. Sharing an office and working closely with the Centre for Effective Altruism, the institute's stated objective was to focus research where it can make the greatest positive difference for humanity in the long term. It engaged in a mix of academic and outreach activities, seeking to promote informed discussion and public engagement in government, businesses, universities, and other organizations. The centre's largest research funders included Amlin, Elon Musk, the European Research Council, Future of Life Institute, and Leverhulme Trust. On 16 April 2024 the Univers ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
