Stochastic (,
) refers to the property of being well described by a
random probability distribution
In probability theory and statistics, a probability distribution is the mathematical function that gives the probabilities of occurrence of different possible outcomes for an experiment. It is a mathematical description of a random phenomenon i ...
.
Although stochasticity and randomness are distinct in that the former refers to a modeling approach and the latter refers to phenomena themselves, these two terms are often used
synonymous
A synonym is a word, morpheme, or phrase that means exactly or nearly the same as another word, morpheme, or phrase in a given language. For example, in the English language, the words ''begin'', ''start'', ''commence'', and ''initiate'' are all ...
ly. Furthermore, in
probability theory, the formal concept of a ''
stochastic process
In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
'' is also referred to as a ''random process''.
Stochasticity is used in many different fields, including the
natural sciences such as
biology,
chemistry
Chemistry is the science, scientific study of the properties and behavior of matter. It is a natural science that covers the Chemical element, elements that make up matter to the chemical compound, compounds made of atoms, molecules and ions ...
,
ecology,
neuroscience,
and
physics,
as well as
technology and
engineering fields such as
image processing
An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
,
signal processing,
information theory
Information theory is the scientific study of the quantification (science), quantification, computer data storage, storage, and telecommunication, communication of information. The field was originally established by the works of Harry Nyquist a ...
,
computer science,
cryptography, and
telecommunications.
It is also used in finance, due to seemingly random changes in
financial markets
as well as in medicine, linguistics, music, media, colour theory, botany, manufacturing, and geomorphology.
Etymology
The word ''stochastic'' in English was originally used as an adjective with the definition "pertaining to conjecturing", and stemming from a Greek word meaning "to aim at a mark, guess", and the Oxford English Dictionary gives the year 1662 as its earliest occurrence.
In his work on probability ''Ars Conjectandi'', originally published in Latin in 1713,
Jakob Bernoulli used the phrase "Ars Conjectandi sive Stochastice", which has been translated to "the art of conjecturing or stochastics".
This phrase was used, with reference to Bernoulli, by
Ladislaus Bortkiewicz,
who in 1917 wrote in German the word ''Stochastik'' with a sense meaning random. The term ''stochastic process'' first appeared in English in a 1934 paper by
Joseph Doob.
For the term and a specific mathematical definition, Doob cited another 1934 paper, where the term ''stochastischer Prozeß'' was used in German by
Aleksandr Khinchin,
though the German term had been used earlier in 1931 by
Andrey Kolmogorov.
Mathematics
In the early 1930s, Aleksandr Khinchin gave the first mathematical definition of a stochastic process as a family of random variables indexed by the real line.
Further fundamental work on probability theory and stochastic processes was done by Khinchin as well as other mathematicians such as
Andrey Kolmogorov,
Joseph Doob,
William Feller,
Maurice Fréchet,
Paul Lévy,
Wolfgang Doeblin, and
Harald Cramér
Harald Cramér (; 25 September 1893 – 5 October 1985) was a Swedish mathematician, actuary, and statistician, specializing in mathematical statistics and probabilistic number theory. John Kingman described him as "one of the giants of statist ...
.
Decades later Cramér referred to the 1930s as the "heroic period of mathematical probability theory".
In mathematics, the theory of stochastic processes is an important contribution to
probability theory,
and continues to be an active topic of research for both theory and applications.
The word ''stochastic'' is used to describe other terms and objects in mathematics. Examples include a
stochastic matrix, which describes a stochastic process known as a
Markov process, and stochastic calculus, which involves
differential equations and
integrals based on stochastic processes such as the
Wiener process, also called the Brownian motion process.
Natural science
One of the simplest continuous-time stochastic processes is
Brownian motion. This was first observed by botanist Robert Brown while looking through a microscope at pollen grains in water.
Physics
The
Monte Carlo method is a stochastic method popularized by physics researchers
Stanisław Ulam,
Enrico Fermi
Enrico Fermi (; 29 September 1901 – 28 November 1954) was an Italian (later naturalized American) physicist and the creator of the world's first nuclear reactor, the Chicago Pile-1. He has been called the "architect of the nuclear age" and ...
,
John von Neumann, and
Nicholas Metropolis. The use of
randomness and the repetitive nature of the process are analogous to the activities conducted at a casino.
Methods of simulation and statistical sampling generally did the opposite: using simulation to test a previously understood deterministic problem. Though examples of an "inverted" approach do exist historically, they were not considered a general method until the popularity of the Monte Carlo method spread.
Perhaps the most famous early use was by Enrico Fermi in 1930, when he used a random method to calculate the properties of the newly discovered
neutron. Monte Carlo methods were central to the
simulations required for the
Manhattan Project, though they were severely limited by the computational tools of the time. Therefore, it was only after electronic computers were first built (from 1945 on) that Monte Carlo methods began to be studied in depth. In the 1950s they were used at
Los Alamos for early work relating to the development of the
hydrogen bomb
A thermonuclear weapon, fusion weapon or hydrogen bomb (H bomb) is a second-generation nuclear weapon design. Its greater sophistication affords it vastly greater destructive power than first-generation nuclear bombs, a more compact size, a lowe ...
, and became popularized in the fields of
physics,
physical chemistry, and
operations research. The
RAND Corporation
The RAND Corporation (from the phrase "research and development") is an American nonprofit global policy think tank created in 1948 by Douglas Aircraft Company to offer research and analysis to the United States Armed Forces. It is financed ...
and the
U.S. Air Force were two of the major organizations responsible for funding and disseminating information on Monte Carlo methods during this time, and they began to find a wide application in many different fields.
Uses of Monte Carlo methods require large amounts of random numbers, and it was their use that spurred the development of
pseudorandom number generators, which were far quicker to use than the tables of random numbers which had been previously used for statistical sampling.
Biology
Stochastic resonance
Stochastic resonance (SR) is a phenomenon in which a signal that is normally too weak to be detected by a sensor, can be boosted by adding white noise to the signal, which contains a wide spectrum of frequencies. The frequencies in the white no ...
: In biological systems, introducing stochastic "noise" has been found to help improve the signal strength of the internal feedback loops for balance and other
vestibular communication. It has been found to help diabetic and stroke patients with balance control. Many biochemical events also lend themselves to stochastic analysis.
Gene expression
Gene expression is the process by which information from a gene is used in the synthesis of a functional gene product that enables it to produce end products, protein or non-coding RNA, and ultimately affect a phenotype, as the final effect. The ...
, for example, has a stochastic component through the molecular collisions—as during binding and unbinding of
RNA polymerase
In molecular biology, RNA polymerase (abbreviated RNAP or RNApol), or more specifically DNA-directed/dependent RNA polymerase (DdRP), is an enzyme that synthesizes RNA from a DNA template.
Using the enzyme helicase, RNAP locally opens the ...
to a
gene promoter—via the solution's
Brownian motion.
Creativity
Simonton (2003, ''Psych Bulletin'') argues that creativity in science (of scientists) is a constrained stochastic behaviour such that new theories in all sciences are, at least in part, the product of a
stochastic process
In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
.
Computer science
Stochastic ray tracing
Distributed ray tracing, also called distribution ray tracing and stochastic ray tracing, is a refinement of ray tracing that allows for the rendering of "soft" phenomena.
Conventional ray tracing uses single rays to sample many different domain ...
is the application of
Monte Carlo simulation
Monte Carlo methods, or Monte Carlo experiments, are a broad class of computational algorithms that rely on repeated random sampling to obtain numerical results. The underlying concept is to use randomness to solve problems that might be determini ...
to the
computer graphics ray tracing algorithm. "
Distributed ray tracing samples the
integrand at many randomly chosen points and averages the results to obtain a better approximation. It is essentially an application of the
Monte Carlo method to
3D computer graphics
3D computer graphics, or “3D graphics,” sometimes called CGI, 3D-CGI or three-dimensional computer graphics are graphics that use a three-dimensional representation of geometric data (often Cartesian) that is stored in the computer for th ...
, and for this reason is also called ''Stochastic ray tracing''."
Stochastic forensics analyzes computer crime by viewing computers as stochastic processes.
In
artificial intelligence, stochastic programs work by using probabilistic methods to solve problems, as in
simulated annealing,
stochastic neural network
Artificial neural networks (ANNs), usually simply called neural networks (NNs) or neural nets, are computing systems inspired by the biological neural networks that constitute animal brains.
An ANN is based on a collection of connected units ...
s,
stochastic optimization
Stochastic optimization (SO) methods are optimization methods that generate and use random variables. For stochastic problems, the random variables appear in the formulation of the optimization problem itself, which involves random objective funct ...
,
genetic algorithm
In computer science and operations research, a genetic algorithm (GA) is a metaheuristic inspired by the process of natural selection that belongs to the larger class of evolutionary algorithms (EA). Genetic algorithms are commonly used to gene ...
s, and
genetic programming. A problem itself may be stochastic as well, as in planning under uncertainty.
Finance
The financial markets use stochastic models to represent the seemingly random behaviour of assets such as
stock
In finance, stock (also capital stock) consists of all the shares by which ownership of a corporation or company is divided.Longman Business English Dictionary: "stock - ''especially AmE'' one of the shares into which ownership of a company ...
s,
commodities
In economics, a commodity is an economic good, usually a resource, that has full or substantial fungibility: that is, the market treats instances of the good as equivalent or nearly so with no regard to who produced them.
The price of a comm ...
, relative
currency prices (i.e., the price of one currency compared to that of another, such as the price of US Dollar compared to that of the Euro), and
interest rates. These models are then used by
quantitative analysts to value options on stock prices, bond prices, and on interest rates, see
Markov models. Moreover, it is at the heart of the
insurance industry.
Geomorphology
The formation of river meanders has been analyzed as a stochastic process.
Language and linguistics
Non-deterministic approaches in language studies are largely inspired by the work of
Ferdinand de Saussure
Ferdinand de Saussure (; ; 26 November 1857 – 22 February 1913) was a Swiss linguist, semiotician and philosopher. His ideas laid a foundation for many significant developments in both linguistics and semiotics in the 20th century. He is widel ...
, for example, in
functionalist linguistic theory, which argues that
competence
Competence may refer to:
*Competence (geology), the resistance of a rock against deformation or plastic flow.
*Competence (human resources), a standardized requirement for an individual to properly perform a specific job
*Competence (law), the me ...
is based on
performance
A performance is an act of staging or presenting a play, concert, or other form of entertainment. It is also defined as the action or process of carrying out or accomplishing an action, task, or function.
Management science
In the work place ...
. This distinction in functional theories of grammar should be carefully distinguished from the
''langue'' and ''parole'' distinction. To the extent that linguistic knowledge is constituted by experience with language, grammar is argued to be probabilistic and variable rather than fixed and absolute. This conception of grammar as probabilistic and variable follows from the idea that one's competence changes in accordance with one's experience with language. Though this conception has been contested, it has also provided the foundation for modern statistical natural language processing and for theories of language learning and change.
Manufacturing
Manufacturing processes are assumed to be
stochastic process
In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
es. This assumption is largely valid for either continuous or batch manufacturing processes. Testing and monitoring of the process is recorded using a
process control
An industrial process control in continuous production processes is a discipline that uses industrial control systems to achieve a production level of consistency, economy and safety which could not be achieved purely by human manual control. I ...
chart which plots a given process control parameter over time. Typically a dozen or many more parameters will be tracked simultaneously. Statistical models are used to define limit lines which define when corrective actions must be taken to bring the process back to its intended operational window.
This same approach is used in the service industry where parameters are replaced by processes related to service level agreements.
Media
The marketing and the changing movement of audience tastes and preferences, as well as the solicitation of and the scientific appeal of certain film and television debuts (i.e., their opening weekends, word-of-mouth, top-of-mind knowledge among surveyed groups, star name recognition and other elements of social media outreach and advertising), are determined in part by stochastic modeling. A recent attempt at repeat business analysis was done by Japanese scholars and is part of the Cinematic Contagion Systems patented by Geneva Media Holdings, and such modeling has been used in data collection from the time of the original
Nielsen ratings
Nielsen Media Research (NMR) is an American firm that measures media audiences, including television, radio, theatre, films (via the AMC Theatres MAP program), and newspapers. Headquartered in New York City, it is best known for the Nielsen rat ...
to modern studio and television test audiences.
Medicine
Stochastic effect, or "chance effect" is one classification of radiation effects that refers to the random, statistical nature of the damage. In contrast to the deterministic effect, severity is independent of dose. Only the ''probability'' of an effect increases with dose.
Music
In
music,
mathematical processes based on probability can generate stochastic elements.
Stochastic processes may be used in music to compose a fixed piece or may be produced in performance. Stochastic music was pioneered by
Iannis Xenakis, who coined the term ''stochastic music''. Specific examples of mathematics, statistics, and physics applied to music composition are the use of the
statistical mechanics
In physics, statistical mechanics is a mathematical framework that applies statistical methods and probability theory to large assemblies of microscopic entities. It does not assume or postulate any natural laws, but explains the macroscopic be ...
of gases in ''
Pithoprakta'',
statistical distribution
In statistics, an empirical distribution function (commonly also called an empirical Cumulative Distribution Function, eCDF) is the distribution function associated with the empirical measure of a sample. This cumulative distribution functio ...
of points on a plane in ''
Diamorphoses'', minimal
constraints in ''Achorripsis'', the
normal distribution in ''ST/10'' and ''Atrées'',
Markov chain
A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, this may be thought of as, "What happe ...
s in ''Analogiques'',
game theory
Game theory is the study of mathematical models of strategic interactions among rational agents. Myerson, Roger B. (1991). ''Game Theory: Analysis of Conflict,'' Harvard University Press, p.&nbs1 Chapter-preview links, ppvii–xi It has appli ...
in ''Duel'' and ''Stratégie'',
group theory in ''
Nomos Alpha'' (for
Siegfried Palm),
set theory in ''Herma'' and ''
Eonta
''Eonta'' is a composition for piano, two trumpets, and three tenor trombones by Iannis Xenakis. It was written in 1963–64, and was premiered on December 16, 1964, by the Ensemble du Domaine Musical, with Yuji Takahashi on piano and Pierre Bou ...
'', and
Brownian motion in ''N'Shima''. Xenakis frequently used
computers
A computer is a machine that can be programmed to carry out sequences of arithmetic or logical operations (computation) automatically. Modern digital electronic computers can perform generic sets of operations known as programs. These programs ...
to produce his scores, such as the ''ST'' series including ''Morsima-Amorsima'' and ''Atrées'', and founded
CEMAMu. Earlier,
John Cage
John Milton Cage Jr. (September 5, 1912 – August 12, 1992) was an American composer and music theorist. A pioneer of indeterminacy in music, electroacoustic music, and non-standard use of musical instruments, Cage was one of the leading fi ...
and others had composed ''
aleatoric
Aleatoricism or aleatorism, the noun associated with the adjectival aleatory and aleatoric, is a term popularised by the musical composer Pierre Boulez, but also Witold Lutosławski and Franco Evangelisti, for compositions resulting from "action ...
'' or
indeterminate music, which is created by chance processes but does not have the strict mathematical basis (Cage's ''
Music of Changes'', for example, uses a system of charts based on the ''
I-Ching
The ''I Ching'' or ''Yi Jing'' (, ), usually translated ''Book of Changes'' or ''Classic of Changes'', is an ancient Chinese divination text that is among the oldest of the Chinese classics. Originally a divination manual in the Western Zhou ...
'').
Lejaren Hiller
Lejaren Arthur Hiller Jr. (February 23, 1924, New York City – January 26, 1994, Buffalo, New York)[Lejaren ...](_blank)
and
Leonard Issacson used
generative grammars and
Markov chain
A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, this may be thought of as, "What happe ...
s in their 1957 ''
Illiac Suite''. Modern electronic music production techniques make these processes relatively simple to implement, and many hardware devices such as synthesizers and drum machines incorporate randomization features.
Generative music techniques are therefore readily accessible to composers, performers, and producers.
Social sciences
Stochastic social science theory is similar to
systems theory in that events are interactions of systems, although with a marked emphasis on unconscious processes. The event creates its own conditions of possibility, rendering it unpredictable if simply for the number of variables involved. Stochastic social science theory can be seen as an elaboration of a kind of 'third axis' in which to situate human behavior alongside the traditional 'nature vs. nurture' opposition. See
Julia Kristeva
Julia Kristeva (; born Yuliya Stoyanova Krasteva, bg, Юлия Стоянова Кръстева; on 24 June 1941) is a Bulgarian-French philosopher, literary critic, semiotician, psychoanalyst, feminist, and, most recently, novelist, who has ...
on her usage of the 'semiotic',
Luce Irigaray
Luce Irigaray (born 3 May 1930) is a Belgian-born French feminist, philosopher, linguist, psycholinguist, psychoanalyst, and cultural theorist who examined the uses and misuses of language in relation to women. Irigaray's first and most well know ...
on reverse Heideggerian epistemology, and
Pierre Bourdieu on polythetic space for examples of stochastic social science theory.
The term "Stochastic Terrorism" has fallen into frequent use
[ published August 12, 2019 CNN] with regard to
lone wolf terrorism. The terms "Scripted Violence" and "Stochastic Terrorism" are linked in a "cause <> effect" relationship. "Scripted Violence" rhetoric can result in an act of "Stochastic Terrorism." The phrase "scripted violence" has been used in social science since at least 2002.
Author David Neiwert, who wrote the book ''
Alt-America
''Alt-America: The Rise of the Radical Right in the Age of Trump'' is a 2017 nonfiction book by investigative journalist David Neiwert in which provides an account of how disparate but interrelated elements of American culture ranging from the B ...
'', told Salon interviewer Chauncey Devega:
Subtractive color reproduction
When color reproductions are made, the image is separated into its component colors by taking multiple photographs filtered for each color. One resultant film or plate represents each of the cyan, magenta, yellow, and black data.
Color printing is a binary system, where ink is either present or not present, so all color separations to be printed must be translated into dots at some stage of the work-flow. Traditional
line screens which are
amplitude modulated
Amplitude modulation (AM) is a modulation technique used in electronic communication, most commonly for transmitting messages with a radio wave. In amplitude modulation, the amplitude (signal strength) of the wave is varied in proportion to t ...
had problems with
moiré but were used until
stochastic screening became available. A stochastic (or
frequency modulated) dot pattern creates a sharper image.
See also
*
Jump process
*
Sortition
*
Stochastic process
In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
Notes
References
Further reading
* ''Formalized Music: Thought and Mathematics in Composition'' by
Iannis Xenakis,
* ''Frequency and the Emergence of Linguistic Structure'' by Joan Bybee and Paul Hopper (eds.), / (Eur.)
* The
Stochastic Empirical Loading and Dilution Model
Stochastic (, ) refers to the property of being well described by a random probability distribution. Although stochasticity and randomness are distinct in that the former refers to a modeling approach and the latter refers to phenomena themselve ...
provides documentation and computer code for modeling stochastic processes in
Visual Basic for Applications.
External links
*
{{Authority control
*
Mathematical terminology