Inferences are steps in
logical reasoning
Logical reasoning is a mind, mental Action (philosophy), activity that aims to arrive at a Logical consequence, conclusion in a Rigour, rigorous way. It happens in the form of inferences or arguments by starting from a set of premises and reason ...
, moving from
premise
A premise or premiss is a proposition—a true or false declarative statement—used in an argument to prove the truth of another proposition called the conclusion. Arguments consist of a set of premises and a conclusion.
An argument is meaningf ...
s to
logical consequence
Logical consequence (also entailment or logical implication) is a fundamental concept in logic which describes the relationship between statement (logic), statements that hold true when one statement logically ''follows from'' one or more stat ...
s; etymologically, the word ''
infer'' means to "carry forward". Inference is theoretically traditionally divided into
deduction and
induction, a distinction that in Europe dates at least to
Aristotle
Aristotle (; 384–322 BC) was an Ancient Greek philosophy, Ancient Greek philosopher and polymath. His writings cover a broad range of subjects spanning the natural sciences, philosophy, linguistics, economics, politics, psychology, a ...
(300s BC). Deduction is inference
deriving logical conclusions from premises known or assumed to be
true
True most commonly refers to truth, the state of being in congruence with fact or reality.
True may also refer to:
Places
* True, West Virginia, an unincorporated community in the United States
* True, Wisconsin, a town in the United States
* ...
, with the
laws of valid inference being studied in
logic
Logic is the study of correct reasoning. It includes both formal and informal logic. Formal logic is the study of deductively valid inferences or logical truths. It examines how conclusions follow from premises based on the structure o ...
. Induction is inference from
particular evidence to a
universal conclusion. A third type of inference is sometimes distinguished, notably by
Charles Sanders Peirce
Charles Sanders Peirce ( ; September 10, 1839 – April 19, 1914) was an American scientist, mathematician, logician, and philosopher who is sometimes known as "the father of pragmatism". According to philosopher Paul Weiss (philosopher), Paul ...
, contradistinguishing
abduction from induction.
Various fields study how inference is done in practice. Human inference (i.e. how humans draw conclusions) is traditionally studied within the fields of logic, argumentation studies, and
cognitive psychology
Cognitive psychology is the scientific study of human mental processes such as attention, language use, memory, perception, problem solving, creativity, and reasoning.
Cognitive psychology originated in the 1960s in a break from behaviorism, whi ...
;
artificial intelligence
Artificial intelligence (AI) is the capability of computer, computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of re ...
researchers develop automated inference systems to emulate human inference.
Statistical inference
Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical analysis infers properties of ...
uses mathematics to draw conclusions in the presence of uncertainty. This generalizes deterministic reasoning, with the absence of uncertainty as a special case. Statistical inference uses quantitative or qualitative (
categorical) data which may be subject to random variations.
Definition
The process by which a conclusion is inferred from multiple
observations is called
inductive reasoning
Inductive reasoning refers to a variety of method of reasoning, methods of reasoning in which the conclusion of an argument is supported not with deductive certainty, but with some degree of probability. Unlike Deductive reasoning, ''deductive'' ...
. The conclusion may be correct or incorrect, or correct to within a certain degree of accuracy, or correct in certain situations. Conclusions inferred from multiple observations may be tested by additional observations.
This definition is disputable (due to its lack of clarity. Ref: Oxford English dictionary: "induction ... 3. Logic the inference of a general law from particular instances." ) The definition given thus applies only when the "conclusion" is general.
Two possible definitions of "inference" are:
# A conclusion reached on the basis of evidence and reasoning.
# The process of reaching such a conclusion.
Examples
Example for definition #1
Ancient Greek philosophers defined a number of
syllogism
A syllogism (, ''syllogismos'', 'conclusion, inference') is a kind of logical argument that applies deductive reasoning to arrive at a conclusion based on two propositions that are asserted or assumed to be true.
In its earliest form (defin ...
s, correct three part inferences, that can be used as building blocks for more complex reasoning. We begin with a famous example:
# All humans are mortal.
# All Greeks are humans.
# All Greeks are mortal.
The reader can check that the premises and conclusion are true, but logic is concerned with inference: does the truth of the conclusion follow from that of the premises?
The validity of an inference depends on the form of the inference. That is, the word "valid" does not refer to the truth of the premises or the conclusion, but rather to the form of the inference. An inference can be valid even if the parts are false, and can be invalid even if some parts are true. But a valid form with true premises will always have a true conclusion.
For example, consider the form of the following
symbological track:
#All meat comes from animals.
#All beef is meat.
#Therefore, all beef comes from animals.
If the premises are true, then the conclusion is necessarily true, too.
Now we turn to an invalid form.
#All A are B.
#All C are B.
#Therefore, all C are A.
To show that this form is invalid, we demonstrate how it can lead from true premises to a false conclusion.
#All apples are fruit. (True)
#All bananas are fruit. (True)
#Therefore, all bananas are apples. (False)
A valid argument with a false premise may lead to a false conclusion, (this and the following examples do not follow the Greek syllogism):
#All tall people are French. (False)
#John Lennon was tall. (True)
#Therefore, John Lennon was French. (False)
When a valid argument is used to derive a false conclusion from a false premise, the inference is valid because it follows the form of a correct inference.
A valid argument can also be used to derive a true conclusion from a false premise:
#All tall people are musicians. (Valid, False)
#John Lennon was tall. (Valid, True)
#Therefore, John Lennon was a musician. (Valid, True)
In this case we have one false premise and one true premise where a true conclusion has been inferred.
Example for definition #2
Evidence: It is the early 1950s and you are an American stationed in the
Soviet Union
The Union of Soviet Socialist Republics. (USSR), commonly known as the Soviet Union, was a List of former transcontinental countries#Since 1700, transcontinental country that spanned much of Eurasia from 1922 until Dissolution of the Soviet ...
. You read in the
Moscow
Moscow is the Capital city, capital and List of cities and towns in Russia by population, largest city of Russia, standing on the Moskva (river), Moskva River in Central Russia. It has a population estimated at over 13 million residents with ...
newspaper that a
soccer
Association football, more commonly known as football or soccer, is a team sport played between two teams of 11 Football player, players who almost exclusively use their feet to propel a Ball (association football), ball around a rectangular f ...
team from a small city in
Siberia
Siberia ( ; , ) is an extensive geographical region comprising all of North Asia, from the Ural Mountains in the west to the Pacific Ocean in the east. It has formed a part of the sovereign territory of Russia and its predecessor states ...
starts winning game after game. The team even defeats the Moscow team. Inference: The small city in Siberia is not a small city anymore. The Soviets are working on their own nuclear or high-value secret weapons program.
Knowns: The Soviet Union is a
command economy
A planned economy is a type of economic system where investment, production and the allocation of capital goods takes place according to economy-wide economic plans and production plans. A planned economy may use centralized, decentralized, ...
: people and material are told where to go and what to do. The small city was remote and historically had never distinguished itself; its soccer season was typically short because of the weather.
Explanation: In a
command economy
A planned economy is a type of economic system where investment, production and the allocation of capital goods takes place according to economy-wide economic plans and production plans. A planned economy may use centralized, decentralized, ...
, people and material are moved where they are needed. Large cities might field good teams due to the greater availability of high quality players; and teams that can practice longer (possibly due to sunnier weather and better facilities) can reasonably be expected to be better. In addition, you put your best and brightest in places where they can do the most good—such as on high-value weapons programs. It is an anomaly for a small city to field such a good team. The anomaly indirectly described a condition by which the observer inferred a new meaningful pattern—that the small city was no longer small. Why would you put a large city of your best and brightest in the middle of nowhere? To hide them, of course.
Incorrect inference
An incorrect inference is known as a
fallacy
A fallacy is the use of invalid or otherwise faulty reasoning in the construction of an argument that may appear to be well-reasoned if unnoticed. The term was introduced in the Western intellectual tradition by the Aristotelian '' De Sophisti ...
. Philosophers who study
informal logic
Informal logic encompasses the principles of logic and logical thought outside of a formal setting (characterized by the usage of particular statements). However, the precise definition of "informal logic" is a matter of some dispute. Ralph H. ...
have compiled large lists of them, and cognitive psychologists have documented many
biases in human reasoning that favor incorrect reasoning.
Applications
Inference engines
AI systems first provided automated logical inference and these were once extremely popular research topics, leading to industrial applications under the form of
expert system
In artificial intelligence (AI), an expert system is a computer system emulating the decision-making ability of a human expert.
Expert systems are designed to solve complex problems by reasoning through bodies of knowledge, represented mainly as ...
s and later
business rule engines. More recent work on
automated theorem proving
Automated theorem proving (also known as ATP or automated deduction) is a subfield of automated reasoning and mathematical logic dealing with proving mathematical theorems by computer programs. Automated reasoning over mathematical proof was a majo ...
has had a stronger
basis in formal logic.
An inference system's job is to extend a knowledge base automatically. The
knowledge base
In computer science, a knowledge base (KB) is a set of sentences, each sentence given in a knowledge representation language, with interfaces to tell new sentences and to ask questions about what is known, where either of these interfaces migh ...
(KB) is a set of propositions that represent what the system knows about the world. Several techniques can be used by that system to extend KB by means of valid inferences. An additional requirement is that the conclusions the system arrives at are
relevant to its task.
Additionally, the term 'inference' has also been applied to the process of generating predictions from trained
neural networks
A neural network is a group of interconnected units called neurons that send signals to one another. Neurons can be either Cell (biology), biological cells or signal pathways. While individual neurons are simple, many of them together in a netwo ...
. In this context, an 'inference engine' refers to the system or hardware performing these operations. This type of inference is widely used in applications ranging from
image recognition to
natural language processing
Natural language processing (NLP) is a subfield of computer science and especially artificial intelligence. It is primarily concerned with providing computers with the ability to process data encoded in natural language and is thus closely related ...
.
Prolog engine
Prolog
Prolog is a logic programming language that has its origins in artificial intelligence, automated theorem proving, and computational linguistics.
Prolog has its roots in first-order logic, a formal logic. Unlike many other programming language ...
(for "Programming in Logic") is a
programming language
A programming language is a system of notation for writing computer programs.
Programming languages are described in terms of their Syntax (programming languages), syntax (form) and semantics (computer science), semantics (meaning), usually def ...
based on a
subset
In mathematics, a Set (mathematics), set ''A'' is a subset of a set ''B'' if all Element (mathematics), elements of ''A'' are also elements of ''B''; ''B'' is then a superset of ''A''. It is possible for ''A'' and ''B'' to be equal; if they a ...
of
predicate calculus
Predicate or predication may refer to:
* Predicate (grammar), in linguistics
* Predication (philosophy)
* several closely related uses in mathematics and formal logic:
**Predicate (mathematical logic)
** Propositional function
**Finitary relation, ...
. Its main job is to check whether a certain proposition can be inferred from a KB (knowledge base) using an algorithm called
backward chaining.
Let us return to our
Socrates
Socrates (; ; – 399 BC) was a Ancient Greek philosophy, Greek philosopher from Classical Athens, Athens who is credited as the founder of Western philosophy and as among the first moral philosophers of the Ethics, ethical tradition ...
syllogism
A syllogism (, ''syllogismos'', 'conclusion, inference') is a kind of logical argument that applies deductive reasoning to arrive at a conclusion based on two propositions that are asserted or assumed to be true.
In its earliest form (defin ...
. We enter into our Knowledge Base the following piece of code:
mortal(X) :- man(X).
man(socrates).
( Here '':-'' can be read as "if". Generally, if ''P Q'' (if P then Q) then in Prolog we would code ''Q:-P'' (Q if P).)
This states that all men are mortal and that Socrates is a man. Now we can ask the Prolog system about Socrates:
?- mortal(socrates).
(where ''?-'' signifies a query: Can ''mortal(socrates).'' be deduced from the KB using the rules)
gives the answer "Yes".
On the other hand, asking the Prolog system the following:
?- mortal(plato).
gives the answer "No".
This is because
Prolog
Prolog is a logic programming language that has its origins in artificial intelligence, automated theorem proving, and computational linguistics.
Prolog has its roots in first-order logic, a formal logic. Unlike many other programming language ...
does not know anything about
Plato
Plato ( ; Greek language, Greek: , ; born BC, died 348/347 BC) was an ancient Greek philosopher of the Classical Greece, Classical period who is considered a foundational thinker in Western philosophy and an innovator of the writte ...
, and hence defaults to any property about Plato being false (the so-called
closed world assumption). Finally
?- mortal(X) (Is anything mortal) would result in "Yes" (and in some implementations: "Yes": X=socrates)
Prolog
Prolog is a logic programming language that has its origins in artificial intelligence, automated theorem proving, and computational linguistics.
Prolog has its roots in first-order logic, a formal logic. Unlike many other programming language ...
can be used for vastly more complicated inference tasks. See the corresponding article for further examples.
Semantic web
Recently automatic reasoners found in
semantic web
The Semantic Web, sometimes known as Web 3.0, is an extension of the World Wide Web through standards set by the World Wide Web Consortium (W3C). The goal of the Semantic Web is to make Internet data machine-readable.
To enable the encoding o ...
a new field of application. Being based upon
description logic, knowledge expressed using one variant of
OWL can be logically processed, i.e., inferences can be made upon it.
Bayesian statistics and probability logic
Philosophers and scientists who follow the
Bayesian framework for inference use the mathematical rules of
probability
Probability is a branch of mathematics and statistics concerning events and numerical descriptions of how likely they are to occur. The probability of an event is a number between 0 and 1; the larger the probability, the more likely an e ...
to find this best explanation. The Bayesian view has a number of desirable features—one of them is that it embeds deductive (certain) logic as a subset (this prompts some writers to call Bayesian probability "probability logic", following
E. T. Jaynes).
Bayesians identify probabilities with degrees of beliefs, with certainly true propositions having probability 1, and certainly false propositions having probability 0. To say that "it's going to rain tomorrow" has a 0.9 probability is to say that you consider the possibility of rain tomorrow as extremely likely.
Through the rules of probability, the probability of a conclusion and of alternatives can be calculated. The best explanation is most often identified with the most probable (see
Bayesian decision theory). A central rule of Bayesian inference is
Bayes' theorem
Bayes' theorem (alternatively Bayes' law or Bayes' rule, after Thomas Bayes) gives a mathematical rule for inverting Conditional probability, conditional probabilities, allowing one to find the probability of a cause given its effect. For exampl ...
.
Fuzzy logic
Non-monotonic logic
A relation of inference is
monotonic
In mathematics, a monotonic function (or monotone function) is a function between ordered sets that preserves or reverses the given order. This concept first arose in calculus, and was later generalized to the more abstract setting of ord ...
if the addition of premises does not undermine previously reached conclusions; otherwise the relation is
non-monotonic.
Deductive inference is monotonic: if a conclusion is reached on the basis of a certain set of premises, then that conclusion still holds if more premises are added.
By contrast, everyday reasoning is mostly non-monotonic because it involves risk: we jump to conclusions from deductively insufficient premises.
We know when it is worth or even necessary (e.g. in medical diagnosis) to take the risk. Yet we are also aware that such inference is defeasible—that new information may undermine old conclusions. Various kinds of defeasible but remarkably successful inference have traditionally captured the attention of philosophers (theories of induction, Peirce's theory of
abduction, inference to the best explanation, etc.). More recently logicians have begun to approach the phenomenon from a formal point of view. The result is a large body of theories at the interface of philosophy, logic and artificial intelligence.
See also
*
*
*
*
*
*
*
*
**
*
*
*
*
*
*
*
*
*
*
*
References
Further reading
*
*
*
*
*
Inductive inference:
*
*
*
*
*
*
*
Abductive inference:
*
*
*
Psychological investigations about human reasoning:
* deductive:
**
**
**
**
**
* statistical:
**
**,
* analogical:
**
* spatial:
**
**
**
* moral:
**
External links
*
Inference example and definition*
{{Authority control
Concepts in epistemology
Concepts in logic
Concepts in metaphilosophy
Concepts in metaphysics
Concepts in the philosophy of mind
History of logic
Intellectual history
Logic
Logic and statistics
Logical consequence
Metaphysics of mind
Reasoning
Semantics
Sources of knowledge
Thought