The Conference and Workshop on Neural Information Processing Systems (abbreviated as NeurIPS and formerly NIPS) is a
machine learning
Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence.
Machine ...
and
computational neuroscience
Computational neuroscience (also known as theoretical neuroscience or mathematical neuroscience) is a branch of neuroscience which employs mathematical models, computer simulations, theoretical analysis and abstractions of the brain to ...
conference held every December. The conference is currently a double-track meeting (single-track until 2015) that includes invited talks as well as oral and poster presentations of refereed papers, followed by parallel-track workshops that up to 2013 were held at ski resorts.
History
The NeurIPS meeting was first proposed in 1986 at the annual invitation-only Snowbird Meeting on
Neural Networks
A neural network is a network or circuit of biological neurons, or, in a modern sense, an artificial neural network, composed of artificial neurons or nodes. Thus, a neural network is either a biological neural network, made up of biological ...
for Computing organized by
The California Institute of Technology
The California Institute of Technology (branded as Caltech or CIT)The university itself only spells its short form as "Caltech"; the institution considers other spellings such a"Cal Tech" and "CalTech" incorrect. The institute is also occasional ...
and
Bell Laboratories
Nokia Bell Labs, originally named Bell Telephone Laboratories (1925–1984),
then AT&T Bell Laboratories (1984–1996)
and Bell Labs Innovations (1996–2007),
is an American industrial research and scientific development company owned by mul ...
. NeurIPS was designed as a complementary open interdisciplinary meeting for researchers exploring biological and artificial
Neural Networks
A neural network is a network or circuit of biological neurons, or, in a modern sense, an artificial neural network, composed of artificial neurons or nodes. Thus, a neural network is either a biological neural network, made up of biological ...
. Reflecting this multidisciplinary approach, NeurIPS began in 1987 with information theorist Ed Posner as the conference president and learning theorist
Yaser Abu-Mostafa
Yaser Said Abu-Mostafa ( Arabic: ياسر سعيد أبو مصطفى) is Professor of Electrical Engineering and Computer Science at the California Institute of Technology, Chairman of Paraconic Technologies Ltd, and Chairman of Machine Learning ...
as program chairman. Research presented in the early NeurIPS meetings included a wide range of topics from efforts to solve purely engineering problems to the use of computer models as a tool for understanding biological nervous systems. Since then, the biological and artificial systems research streams have diverged, and recent NeurIPS proceedings have been dominated by papers on
machine learning
Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence.
Machine ...
,
artificial intelligence
Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machine
A machine is a physical system using Power (physics), power to apply Force, forces and control Motion, moveme ...
and statistics.
From 1987 until 2000 NeurIPS was held in
Denver
Denver () is a consolidated city and county, the capital, and most populous city of the U.S. state of Colorado. Its population was 715,522 at the 2020 census, a 19.22% increase since 2010. It is the 19th-most populous city in the United ...
, United States. Since then, the conference was held in
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the most populous city in the province, the 2021 Canadian census recorded 662,248 people in the city, up from 631,486 in 2016. Th ...
, Canada (2001–2010),
Granada
Granada (,, DIN: ; grc, Ἐλιβύργη, Elibýrgē; la, Illiberis or . ) is the capital city of the province of Granada, in the autonomous community of Andalusia, Spain. Granada is located at the foot of the Sierra Nevada mountains, at the c ...
, Spain (2011), and
Lake Tahoe
Lake Tahoe (; was, Dáʔaw, meaning "the lake") is a freshwater lake in the Sierra Nevada of the United States. Lying at , it straddles the state line between California and Nevada, west of Carson City. Lake Tahoe is the largest alpine lake ...
, United States (2012–2013). In 2014 and 2015, the conference was held in
Montreal
Montreal ( ; officially Montréal, ) is the second-most populous city in Canada and most populous city in the Canadian province of Quebec. Founded in 1642 as '' Ville-Marie'', or "City of Mary", it is named after Mount Royal, the triple- ...
, Canada, in Barcelona, Spain in 2016, in Long Beach, United States in 2017, in Montreal, Canada in 2018 and Vancouver, Canada in 2019. Reflecting its origins at Snowbird, Utah, the meeting was accompanied by workshops organized at a nearby ski resort up until 2013, when it outgrew ski resorts.
The first NeurIPS Conference was sponsored by the
IEEE
The Institute of Electrical and Electronics Engineers (IEEE) is a 501(c)(3) professional association for electronic engineering and electrical engineering (and associated disciplines) with its corporate office in New York City and its operati ...
. The following NeurIPS Conferences have been organized by the NeurIPS Foundation, established by Ed Posner. Terrence Sejnowski has been the president of the NeurIPS Foundation since Posner's death in 1993. The board of trustees consists of previous general chairs of the NeurIPS Conference.
The first
proceedings
In academia and librarianship, conference proceedings is a collection of academic papers published in the context of an academic conference or workshop. Conference proceedings typically contain the contributions made by researchers at the confer ...
was published in book form by the American Institute of Physics in 1987, and was entitled ''Neural Information Processing Systems'', then the
proceedings
In academia and librarianship, conference proceedings is a collection of academic papers published in the context of an academic conference or workshop. Conference proceedings typically contain the contributions made by researchers at the confer ...
from the following conferences have been published by Morgan Kaufmann (1988–1993),
MIT Press
The MIT Press is a university press affiliated with the Massachusetts Institute of Technology (MIT) in Cambridge, Massachusetts (United States). It was established in 1962.
History
The MIT Press traces its origins back to 1926 when MIT publ ...
(1994–2004) and Curran Associates (2005–present) under the name ''Advances in Neural Information Processing Systems''.
The conference was originally abbreviated as "NIPS". By 2018 a few commentators were criticizing the abbreviation as encouraging sexism due to its association with the word ''
nipple
The nipple is a raised region of tissue on the surface of the breast from which, in females, milk leaves the breast through the lactiferous ducts to feed an infant. The milk can flow through the nipple passively or it can be ejected by smooth ...
s'', and as being a slur against Japanese. The board changed the abbreviation to "NeurIPS" in November 2018.
Topics
Along with machine learning and neuroscience, other fields represented at NeurIPS include cognitive science,
psychology
Psychology is the scientific study of mind and behavior. Psychology includes the study of conscious and unconscious phenomena, including feelings and thoughts. It is an academic discipline of immense scope, crossing the boundaries betwe ...
,
computer vision
Computer vision is an Interdisciplinarity, interdisciplinary scientific field that deals with how computers can gain high-level understanding from digital images or videos. From the perspective of engineering, it seeks to understand and automate t ...
, statistical
linguistics
Linguistics is the scientific study of human language. It is called a scientific study because it entails a comprehensive, systematic, objective, and precise analysis of all aspects of language, particularly its nature and structure. Lingu ...
, and
information theory
Information theory is the scientific study of the quantification, storage, and communication of information. The field was originally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s. ...
. Over the years, NeurIPS became a premier conference on machine learning and although the 'Neural' in the NeurIPS acronym had become something of a historical relic, the resurgence of deep learning in neural networks since 2012, fueled by faster computers and big data, has led to achievements in speech recognition, object recognition in images,
image captioning
Natural language generation (NLG) is a software process that produces natural language output. In one of the most widely-cited survey of NLG methods, NLG is characterized as "the subfield of artificial intelligence and computational linguistics tha ...
, language translation and world championship performance in the game of Go, based on neural architectures inspired by the hierarchy of areas in the visual cortex (ConvNet) and reinforcement learning inspired by the basal ganglia (Temporal difference learning).
Notable affinity groups have emerged from the NeurIPS conference and displayed diversity, including Black in AI (in 2017),
Queer in AI
''Queer'' is an umbrella term for people who are not heterosexual or cisgender. Originally meaning or , ''queer'' came to be used pejoratively against those with same-sex desires or relationships in the late 19th century. Beginning in the lat ...
(in 2016), and others.
Named lectures
In addition to invited talks and symposia, NeurIPS also organizes two named lectureships to recognize distinguished researchers. The NeurIPS Board introduced the Posner Lectureship in honor of NeurIPS founder Ed Posner; two Posner Lectures were given each year up to 2015. Past lecturers have included:
*2021 – Peter Bartlett
*2018 –
Joëlle Pineau
Joëlle Pineau (born 1974) is a Canadian computer scientist and associate professor at McGill University. She is the lead of Facebook's Artificial Intelligence Research lab (FAIR) in Montreal, Quebec.
Early life and education
Pineau was born i ...
Zoubin Ghahramani
Zoubin Ghahramani FRS ( fa, زوبین قهرمانی; born 8 February 1970) is a British-Iranian researcher and Professor of Information Engineering at the University of Cambridge. He holds joint appointments at University College London and ...
Peter Dayan
Peter Dayan is director at the Max Planck Institute for Biological Cybernetics in Tübingen, Germany. He is co-author of ''Theoretical Neuroscience'', an influential textbook on computational neuroscience. He is known for applying Bayesian m ...
Josh Tenenbaum
Joshua Brett Tenenbaum (Josh Tenenbaum) is Professor of Computational Cognitive Science at the Massachusetts Institute of Technology. He is known for contributions to mathematical psychology and Bayesian cognitive science. According to the MacAr ...
and Michael I. Jordan
In 2015, the NeurIPS Board introduced the Breiman Lectureship to highlight work in statistics relevant to conference topics. The lectureship was named for statistician
Leo Breiman
Leo Breiman (January 27, 1928 – July 5, 2005) was a distinguished statistician at the University of California, Berkeley. He was the recipient of numerous honors and awards, and was a member of the United States National Academy of Sciences. ...
, who served on the NeurIPS Board from 1994 to 2005. Past lecturers have included:
*2021 – Gabor Lugosi
*2020 – Marloes Maathuis
*2019 –
Bin Yu
Bin Yu () is a Chinese-American statistician. She is currently Chancellor's Professor in the Departments of Statistics and of Electrical Engineering & Computer Sciences at the University of California, Berkeley.
Susan Holmes
Susan Elizabeth Holmes-McKagan (born May 5, 1972) is an American model, television personality, and fashion designer. She is also known as the public face and founder of her business venture Susan Holmes Swimwear. According to an interview by ...
In NIPS 2014, the program chairs duplicated 10% of all submissions and sent them through separate reviewers to evaluate randomness in the reviewing process. Several researchers interpreted the result. Regarding whether the decision in NIPS is completely random or not, John Langford writes: "Clearly not—a purely random decision would have arbitrariness of ~78%. It is, however, quite notable that 60% is much closer to 78% than 0%." He concludes that the result of the reviewing process is mostly arbitrary.
Editions
Past editions:
* 1987–2000:
Denver
Denver () is a consolidated city and county, the capital, and most populous city of the U.S. state of Colorado. Its population was 715,522 at the 2020 census, a 19.22% increase since 2010. It is the 19th-most populous city in the United ...
,
Colorado
Colorado (, other variants) is a state in the Mountain states, Mountain West subregion of the Western United States. It encompasses most of the Southern Rocky Mountains, as well as the northeastern portion of the Colorado Plateau and the wes ...
, United States
* 2001–2010:
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the most populous city in the province, the 2021 Canadian census recorded 662,248 people in the city, up from 631,486 in 2016. Th ...
,
British Columbia
British Columbia (commonly abbreviated as BC) is the westernmost Provinces and territories of Canada, province of Canada, situated between the Pacific Ocean and the Rocky Mountains. It has a diverse geography, with rugged landscapes that include ...
, Canada
* 2011:
Granada
Granada (,, DIN: ; grc, Ἐλιβύργη, Elibýrgē; la, Illiberis or . ) is the capital city of the province of Granada, in the autonomous community of Andalusia, Spain. Granada is located at the foot of the Sierra Nevada mountains, at the c ...
Nevada
Nevada ( ; ) is a state in the Western region of the United States. It is bordered by Oregon to the northwest, Idaho to the northeast, California to the west, Arizona to the southeast, and Utah to the east. Nevada is the 7th-most extensive, ...
Quebec
Quebec ( ; )According to the Government of Canada, Canadian government, ''Québec'' (with the acute accent) is the official name in Canadian French and ''Quebec'' (without the accent) is the province's official name in Canadian English is ...
, Canada
* 2016:
Barcelona
Barcelona ( , , ) is a city on the coast of northeastern Spain. It is the capital and largest city of the autonomous community of Catalonia, as well as the second most populous municipality of Spain. With a population of 1.6 million within ...
California
California is a state in the Western United States, located along the Pacific Coast. With nearly 39.2million residents across a total area of approximately , it is the most populous U.S. state and the 3rd largest by area. It is also the ...
Quebec
Quebec ( ; )According to the Government of Canada, Canadian government, ''Québec'' (with the acute accent) is the official name in Canadian French and ''Quebec'' (without the accent) is the province's official name in Canadian English is ...
, Canada
* 2019:
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the most populous city in the province, the 2021 Canadian census recorded 662,248 people in the city, up from 631,486 in 2016. Th ...
,
British Columbia
British Columbia (commonly abbreviated as BC) is the westernmost Provinces and territories of Canada, province of Canada, situated between the Pacific Ocean and the Rocky Mountains. It has a diverse geography, with rugged landscapes that include ...
, Canada
* 2020:
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the most populous city in the province, the 2021 Canadian census recorded 662,248 people in the city, up from 631,486 in 2016. Th ...
,
British Columbia
British Columbia (commonly abbreviated as BC) is the westernmost Provinces and territories of Canada, province of Canada, situated between the Pacific Ocean and the Rocky Mountains. It has a diverse geography, with rugged landscapes that include ...
Louisiana
Louisiana , group=pronunciation (French: ''La Louisiane'') is a U.S. state, state in the Deep South and South Central United States, South Central regions of the United States. It is the List of U.S. states and territories by area, 20th-smal ...
CIBB
The International Conference on Computational Intelligence Methods for Bioinformatics and Biostatistics (CIBB) is a yearly scientific conference focused on machine learning and computational intelligence applied to bioinformatics and biostatisti ...
AAAI
The Association for the Advancement of Artificial Intelligence (AAAI) is an international scientific society devoted to promote research in, and responsible use of, artificial intelligence. AAAI also aims to increase public understanding of artif ...