Texas Sharpshooter Fallacy
   HOME

TheInfoList



OR:

The Texas sharpshooter fallacy is an
informal fallacy Informal fallacies are a type of incorrect argument in natural language. The source of the error is not just due to the ''form'' of the argument, as is the case for formal fallacies, but can also be due to their ''content'' and ''context''. Fallac ...
which is committed when differences in data are ignored, but similarities are overemphasized. From this reasoning, a false conclusion is inferred. This fallacy is the philosophical or rhetorical application of the
multiple comparisons Multiple comparisons, multiplicity or multiple testing problem occurs in statistics when one considers a set of statistical inferences simultaneously or estimates a subset of parameters selected based on the observed values. The larger the numbe ...
problem (in statistics) and
apophenia Apophenia () is the tendency to perceive meaningful connections between unrelated things. The term ( from the ) was coined by psychiatrist Klaus Conrad in his 1958 publication on the beginning stages of schizophrenia. He defined it as "unmot ...
(in cognitive psychology). It is related to the
clustering illusion The clustering illusion is the tendency to erroneously consider the inevitable "streaks" or "clusters" arising in small samples from random distributions to be non-random. The illusion is caused by a human tendency to underpredict the amount of St ...
, which is the tendency in human
cognition Cognition is the "mental action or process of acquiring knowledge and understanding through thought, experience, and the senses". It encompasses all aspects of intellectual functions and processes such as: perception, attention, thought, ...
to interpret patterns where none actually exist. The name comes from a metaphor about a person from
Texas Texas ( , ; or ) is the most populous U.S. state, state in the South Central United States, South Central region of the United States. It borders Louisiana to the east, Arkansas to the northeast, Oklahoma to the north, New Mexico to the we ...
who fires a gun at the side of a barn, then paints a
shooting target Shooting targets are objects in various forms and shapes that are used for pistol, rifle, shotgun and other shooting sports, as well as in darts, target archery, crossbow shooting and other non-firearm related sports. The center is often call ...
centered on the tightest
cluster may refer to: Science and technology Astronomy * Cluster (spacecraft), constellation of four European Space Agency spacecraft * Cluster II (spacecraft), a European Space Agency mission to study the magnetosphere * Asteroid cluster, a small ...
of shots and claims to be a
sharpshooter A sharpshooter is one who is highly proficient at firing firearms or other projectile weapons accurately. Military units composed of sharpshooters were important factors in 19th-century combat. Along with " marksman" and "expert", "sharpshooter" ...
.


Structure

The Texas sharpshooter fallacy often arises when a person has a large amount of data at their disposal but only focuses on a small subset of that data. Some factor other than the one attributed may give all the elements in that subset some kind of common property (or pair of common properties, when arguing for correlation). If the person attempts to account for the likelihood of finding ''some'' subset in the large data with ''some'' common property by a factor other than its actual cause, then that person is likely committing a Texas sharpshooter fallacy. The fallacy is characterized by a lack of a specific hypothesis prior to the gathering of data, or the formulation of a hypothesis only after data have already been gathered and examined. Thus, it typically does not apply if one had an ''
ex ante The term (sometimes written or ) is a New Latin phrase meaning "before the event". In economics, ''ex-ante'' or notional demand refers to the desire for goods and services that is not backed by the ability to pay for those goods and servi ...
'', or prior, expectation of the particular relationship in question before examining the data. For example, one might, prior to examining the information, have in mind a specific physical mechanism implying the particular relationship. One could then use the information to give support or cast doubt on the presence of that mechanism. Alternatively, if a second set of additional information can be generated using the same process as the original information, one can use the first (original) set of information to construct a hypothesis, and then test the hypothesis on the second (new) set of information. (See
hypothesis testing A statistical hypothesis test is a method of statistical inference used to decide whether the data provide sufficient evidence to reject a particular hypothesis. A statistical hypothesis test typically involves a calculation of a test statistic. T ...
.) However, after constructing a hypothesis on a set of data, one would be committing the Texas sharpshooter fallacy if they then tested that hypothesis on the same data (see
hypotheses suggested by the data In statistics, hypotheses suggested by a given dataset, when tested with the same dataset that suggested them, are likely to be accepted even when they are not true. This is because circular reasoning (double dipping) would be involved: somethi ...
).


Examples

A Swedish study in 1992 tried to determine whether power lines caused some kind of poor health effects. The researchers surveyed people living within 300 metres of high-voltage power lines over 25 years and looked for statistically significant increases in rates of over 800 ailments. The study found that the incidence of childhood leukemia was four times higher among those who lived closest to the power lines, which spurred calls to action by the Swedish government. The problem with the conclusion, however, was that the number of potential ailments, i.e., over 800, was so large that it created a high probability that at least one ailment would have a statistically significant correlation with living distance from power lines by chance alone, a situation known as the
multiple comparisons problem Multiple comparisons, multiplicity or multiple testing problem occurs in statistics when one considers a set of statistical inferences simultaneously or estimates a subset of parameters selected based on the observed values. The larger the numbe ...
. Subsequent studies failed to show any association between power lines and childhood leukemia. The fallacy is often found in modern-day interpretations of the
quatrain A quatrain is a type of stanza, or a complete poem, consisting of four Line (poetry), lines. Existing in a variety of forms, the quatrain appears in poems from the poetic traditions of various ancient civilizations including Persia, Ancient India ...
s of
Nostradamus Michel de Nostredame (December 1503 – July 1566), usually Latinisation of names, Latinised as Nostradamus, was a French Astrology, astrologer, apothecary, physician, and reputed Oracle, seer, who is best known for his book ''Les Prophéti ...
. Nostradamus's quatrains are often liberally translated from their original (archaic) French versions, in which their historical context is often lost, and then applied to support the erroneous conclusion that Nostradamus predicted a given modern-day event after the event actually occurred.


See also

* * * * , also known as p-hacking * * * * * * *


Related fallacies

* * ' * '


References


External links


Fallacy files entry
{{Fallacies Causal fallacies Metaphors referring to war and violence Marksmanship Cognitive biases