HOME

TheInfoList



OR:

A logistic function or logistic curve is a common S-shaped curve ( sigmoid curve) with the equation f(x) = \frac where The logistic function has domain the
real number In mathematics, a real number is a number that can be used to measure a continuous one- dimensional quantity such as a duration or temperature. Here, ''continuous'' means that pairs of values can have arbitrarily small differences. Every re ...
s, the limit as x \to -\infty is 0, and the limit as x \to +\infty is L. The exponential function with negated argument (e^ ) is used to define the standard logistic function, depicted at right, where L=1, k=1, x_0=0, which has the equation f(x) = \frac and is sometimes simply called the sigmoid. It is also sometimes called the expit, being the inverse function of the
logit In statistics, the logit ( ) function is the quantile function associated with the standard logistic distribution. It has many uses in data analysis and machine learning, especially in Data transformation (statistics), data transformations. Ma ...
. The logistic function finds applications in a range of fields, including
biology Biology is the scientific study of life and living organisms. It is a broad natural science that encompasses a wide range of fields and unifying principles that explain the structure, function, growth, History of life, origin, evolution, and ...
(especially
ecology Ecology () is the natural science of the relationships among living organisms and their Natural environment, environment. Ecology considers organisms at the individual, population, community (ecology), community, ecosystem, and biosphere lev ...
), biomathematics,
chemistry Chemistry is the scientific study of the properties and behavior of matter. It is a physical science within the natural sciences that studies the chemical elements that make up matter and chemical compound, compounds made of atoms, molecules a ...
,
demography Demography () is the statistical study of human populations: their size, composition (e.g., ethnic group, age), and how they change through the interplay of fertility (births), mortality (deaths), and migration. Demographic analysis examine ...
,
economics Economics () is a behavioral science that studies the Production (economics), production, distribution (economics), distribution, and Consumption (economics), consumption of goods and services. Economics focuses on the behaviour and interac ...
,
geoscience Earth science or geoscience includes all fields of natural science related to the planet Earth. This is a branch of science dealing with the physical, chemical, and biological complex constitutions and synergistic linkages of Earth's four spheres ...
,
mathematical psychology Mathematical psychology is an approach to psychology, psychological research that is based on mathematical modeling of perceptual, thought, Cognition, cognitive and motor processes, and on the establishment of law-like rules that relate quantifi ...
,
probability Probability is a branch of mathematics and statistics concerning events and numerical descriptions of how likely they are to occur. The probability of an event is a number between 0 and 1; the larger the probability, the more likely an e ...
,
sociology Sociology is the scientific study of human society that focuses on society, human social behavior, patterns of Interpersonal ties, social relationships, social interaction, and aspects of culture associated with everyday life. The term sociol ...
,
political science Political science is the scientific study of politics. It is a social science dealing with systems of governance and Power (social and political), power, and the analysis of political activities, political philosophy, political thought, polit ...
,
linguistics Linguistics is the scientific study of language. The areas of linguistic analysis are syntax (rules governing the structure of sentences), semantics (meaning), Morphology (linguistics), morphology (structure of words), phonetics (speech sounds ...
,
statistics Statistics (from German language, German: ', "description of a State (polity), state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a s ...
, and
artificial neural network In machine learning, a neural network (also artificial neural network or neural net, abbreviated ANN or NN) is a computational model inspired by the structure and functions of biological neural networks. A neural network consists of connected ...
s. There are various
generalizations A generalization is a form of abstraction whereby common properties of specific instances are formulated as general concepts or claims. Generalizations posit the existence of a domain or set of elements, as well as one or more common character ...
, depending on the field.


History

The logistic function was introduced in a series of three papers by
Pierre François Verhulst Pierre François Verhulst (28 October 1804, in Brussels – 15 February 1849, in Brussels) was a Belgian mathematician and a doctor in number theory from the University of Ghent in 1825. He is best known for the logistic growth model. Logisti ...
between 1838 and 1847, who devised it as a model of
population growth Population growth is the increase in the number of people in a population or dispersed group. The World population, global population has grown from 1 billion in 1800 to 8.2 billion in 2025. Actual global human population growth amounts to aroun ...
by adjusting the
exponential growth Exponential growth occurs when a quantity grows as an exponential function of time. The quantity grows at a rate directly proportional to its present size. For example, when it is 3 times as big as it is now, it will be growing 3 times as fast ...
model, under the guidance of
Adolphe Quetelet Lambert Adolphe Jacques Quetelet FRSF or FRSE (; 22 February 1796 – 17 February 1874) was a Belgian- French astronomer, mathematician, statistician and sociologist who founded and directed the Brussels Observatory and was influential ...
. Verhulst first devised the function in the mid 1830s, publishing a brief note in 1838, then presented an expanded analysis and named the function in 1844 (published 1845); the third paper adjusted the correction term in his model of Belgian population growth. The initial stage of growth is approximately exponential (geometric); then, as saturation begins, the growth slows to linear (arithmetic), and at maturity, growth approaches the limit with an exponentially decaying gap, like the initial stage in reverse. Verhulst did not explain the choice of the term "logistic" (), but it is presumably in contrast to the ''logarithmic'' curve, and by analogy with arithmetic and geometric. His growth model is preceded by a discussion of
arithmetic growth In mathematics, the term linear function refers to two distinct but related notions: * In calculus and related areas, a linear function is a function whose graph is a straight line, that is, a polynomial function of degree zero or one. For di ...
and
geometric growth Exponential growth occurs when a quantity grows as an exponential function of time. The quantity grows at a rate direct proportion, directly proportional to its present size. For example, when it is 3 times as big as it is now, it will be growin ...
(whose curve he calls a
logarithmic curve In mathematics, logarithmic growth describes a phenomenon whose size or cost can be described as a logarithm function of some input. e.g. ''y'' = ''C'' log (''x''). Any logarithm base can be used, since one can be converted to anot ...
, instead of the modern term exponential curve), and thus "logistic growth" is presumably named by analogy, ''logistic'' being from , a traditional division of
Greek mathematics Ancient Greek mathematics refers to the history of mathematical ideas and texts in Ancient Greece during Classical antiquity, classical and late antiquity, mostly from the 5th century BC to the 6th century AD. Greek mathematicians lived in cities ...
. As a word derived from ancient Greek mathematical terms, the name of this function is unrelated to the military and management term ''logistics'', which is instead from "lodgings", though some believe the Greek term also influenced ''logistics''; see for details.


Mathematical properties

The is the logistic function with parameters k = 1, x_0 = 0, L = 1, which yields f(x) = \frac = \frac = \frac. In practice, due to the nature of the exponential function e^, it is often sufficient to compute the standard logistic function for x over a small range of real numbers, such as a range contained in ��6, +6 as it quickly converges very close to its saturation values of 0 and 1.


Symmetries

The logistic function has the symmetry property that 1 - f(x) = f(-x). This reflects that the growth from 0 when x is small is symmetric with the decay of the gap to the limit (1) when x is large. Further, x \mapsto f(x) - 1/2 is an odd function. The sum of the logistic function and its reflection about the vertical axis, f(-x), is \frac + \frac = \frac + \frac = 1. The logistic function is thus rotationally symmetrical about the point (0, 1/2).


Inverse function

The logistic function is the inverse of the natural
logit In statistics, the logit ( ) function is the quantile function associated with the standard logistic distribution. It has many uses in data analysis and machine learning, especially in Data transformation (statistics), data transformations. Ma ...
function \operatorname p = \log \frac p \quad \text\, 0 and so converts the logarithm of
odds In probability theory, odds provide a measure of the probability of a particular outcome. Odds are commonly used in gambling and statistics. For example for an event that is 40% probable, one could say that the odds are or When gambling, o ...
into a
probability Probability is a branch of mathematics and statistics concerning events and numerical descriptions of how likely they are to occur. The probability of an event is a number between 0 and 1; the larger the probability, the more likely an e ...
. The conversion from the log-likelihood ratio of two alternatives also takes the form of a logistic curve.


Hyperbolic tangent

The logistic function is an offset and scaled hyperbolic tangent function: f(x) = \frac12 + \frac12 \tanh\left(\frac\right), or \tanh(x) = 2 f(2x) - 1. This follows from \begin \tanh(x) & = \frac = \frac \\ &= f(2x) - \frac = f(2x) - \frac = 2f(2x) - 1. \end The hyperbolic-tangent relationship leads to another form for the logistic function's derivative: \frac f(x) = \frac14 \operatorname^2\left(\frac\right), which ties the logistic function into the
logistic distribution In probability theory and statistics, the logistic distribution is a continuous probability distribution. Its cumulative distribution function is the logistic function, which appears in logistic regression and feedforward neural networks. It rese ...
. Geometrically, the hyperbolic tangent function is the hyperbolic angle on the unit hyperbola x^2 - y^2 = 1, which factors as (x + y)(x - y) = 1, and thus has asymptotes the lines through the origin with slope and with slope , and vertex at corresponding to the range and midpoint () of tanh. Analogously, the logistic function can be viewed as the hyperbolic angle on the hyperbola xy - y^2 = 1, which factors as y(x - y) = 1, and thus has asymptotes the lines through the origin with slope and with slope , and vertex at , corresponding to the range and midpoint () of the logistic function. Parametrically, hyperbolic cosine and
hyperbolic sine In mathematics, hyperbolic functions are analogues of the ordinary trigonometric functions, but defined using the hyperbola rather than the circle. Just as the points form a unit circle, circle with a unit radius, the points form the right ha ...
give coordinates on the unit hyperbola: \left( (e^t + e^)/2, (e^t - e^)/2\right), with quotient the hyperbolic tangent. Similarly, \bigl(e^ + e^, e^\bigr) parametrizes the hyperbola xy - y^2 = 1, with quotient the logistic function. These correspond to
linear transformations In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that pr ...
(and rescaling the parametrization) of the hyperbola xy = 1, with parametrization (e^, e^t): the parametrization of the hyperbola for the logistic function corresponds to t/2 and the linear transformation \bigl( \begin 1 & 1\\ 0 & 1 \end \bigr), while the parametrization of the unit hyperbola (for the hyperbolic tangent) corresponds to the linear transformation \tfrac\bigl( \begin 1 & 1\\ -1 & 1 \end \bigr).


Derivative

The standard logistic function has an easily calculated
derivative In mathematics, the derivative is a fundamental tool that quantifies the sensitivity to change of a function's output with respect to its input. The derivative of a function of a single variable at a chosen input value, when it exists, is t ...
. The derivative is known as the density of the
logistic distribution In probability theory and statistics, the logistic distribution is a continuous probability distribution. Its cumulative distribution function is the logistic function, which appears in logistic regression and feedforward neural networks. It rese ...
: f(x) = \frac = \frac, \begin \frac f(x) &= \frac \\ ex&= \frac \\ ex&= \left(\frac\right) \left(\frac\right) \\ ex&= \left(\frac\right) \left(1-\frac\right) \\ .2ex&= f(x)\left(1 - f(x)\right) \endfrom which all higher derivatives can be derived algebraically. For example, f'' = (1-2f)(1-f)f . The logistic distribution is a location–scale family, which corresponds to parameters of the logistic function. If is fixed, then the midpoint is the location and the slope is the scale.


Integral

Conversely, its
antiderivative In calculus, an antiderivative, inverse derivative, primitive function, primitive integral or indefinite integral of a continuous function is a differentiable function whose derivative is equal to the original function . This can be stated ...
can be computed by the substitution u = 1 + e^x, since f(x) = \frac = \frac, so (dropping the
constant of integration In calculus, the constant of integration, often denoted by C (or c), is a constant term added to an antiderivative of a function f(x) to indicate that the indefinite integral of f(x) (i.e., the set of all antiderivatives of f(x)), on a connecte ...
) \int \frac\,dx = \int \frac\,du = \ln u = \ln (1 + e^x). In
artificial neural network In machine learning, a neural network (also artificial neural network or neural net, abbreviated ANN or NN) is a computational model inspired by the structure and functions of biological neural networks. A neural network consists of connected ...
s, this is known as the '' softplus'' function and (with scaling) is a smooth approximation of the
ramp function The ramp function is a unary real function, whose graph is shaped like a ramp. It can be expressed by numerous definitions, for example "0 for negative inputs, output equals input for non-negative inputs". The term "ramp" can also be used for ...
, just as the logistic function (with scaling) is a smooth approximation of the
Heaviside step function The Heaviside step function, or the unit step function, usually denoted by or (but sometimes , or ), is a step function named after Oliver Heaviside, the value of which is zero for negative arguments and one for positive arguments. Differen ...
.


Taylor series

The standard logistic function is analytic on the whole real line since f : \mathbb \to \mathbb, f(x) = \frac = h(g(x)) where g : \mathbb \to \mathbb, g(x) = 1 + e^ and h : (0, \infty) \to (0, \infty), h(x) = \frac are analytic on their domains, and the composition of analytic functions is again analytic. A formula for the ''n''th derivative of the standard logistic function is \frac = \sum_^n \frac therefore its
Taylor series In mathematics, the Taylor series or Taylor expansion of a function is an infinite sum of terms that are expressed in terms of the function's derivatives at a single point. For most common functions, the function and the sum of its Taylor ser ...
about the point a is f(x) = f(a)(x-a) + \sum_^ \sum_^n \frac \frac .


Logistic differential equation

The unique standard logistic function is the solution of the simple first-order non-linear
ordinary differential equation In mathematics, an ordinary differential equation (ODE) is a differential equation (DE) dependent on only a single independent variable (mathematics), variable. As with any other DE, its unknown(s) consists of one (or more) Function (mathematic ...
\fracf(x) = f(x)\big(1 - f(x)\big) with
boundary condition In the study of differential equations, a boundary-value problem is a differential equation subjected to constraints called boundary conditions. A solution to a boundary value problem is a solution to the differential equation which also satis ...
f(0) = 1/2. This equation is the continuous version of the logistic map. Note that the reciprocal logistic function is solution to a simple first-order ''linear'' ordinary differential equation. The qualitative behavior is easily understood in terms of the phase line: the derivative is 0 when the function is 1; and the derivative is positive for f between 0 and 1, and negative for f above 1 or less than 0 (though negative populations do not generally accord with a physical model). This yields an unstable equilibrium at 0 and a stable equilibrium at 1, and thus for any function value greater than 0 and less than 1, it grows to 1. The logistic equation is a special case of the Bernoulli differential equation and has the following solution: f(x) = \frac. Choosing the constant of integration C = 1 gives the other well known form of the definition of the logistic curve: f(x) = \frac = \frac. More quantitatively, as can be seen from the analytical solution, the logistic curve shows early
exponential growth Exponential growth occurs when a quantity grows as an exponential function of time. The quantity grows at a rate directly proportional to its present size. For example, when it is 3 times as big as it is now, it will be growing 3 times as fast ...
for negative argument, which reaches to linear growth of slope 1/4 for an argument near 0, then approaches 1 with an exponentially decaying gap. The differential equation derived above is a special case of a general differential equation that only models the sigmoid function for x > 0. In many modeling applications, the more ''general form'' \frac = \frac f(x)\big(L - f(x)\big), \quad f(0) = \frac can be desirable. Its solution is the shifted and scaled
sigmoid function A sigmoid function is any mathematical function whose graph of a function, graph has a characteristic S-shaped or sigmoid curve. A common example of a sigmoid function is the logistic function, which is defined by the formula :\sigma(x ...
L \sigma \big(k(x - x_0)\big) = \frac .


Probabilistic interpretation

When the capacity L = 1, the value of the logistic function is in the range and can be interpreted as a probability . In more detail, can be interpreted as the probability of one of two alternatives (the parameter of a
Bernoulli distribution In probability theory and statistics, the Bernoulli distribution, named after Swiss mathematician Jacob Bernoulli, is the discrete probability distribution of a random variable which takes the value 1 with probability p and the value 0 with pro ...
); the two alternatives are complementary, so the probability of the other alternative is q = 1 - p and p + q = 1. The two alternatives are coded as 1 and 0, corresponding to the limiting values as x \to \pm \infty. In this interpretation the input is the
log-odds In statistics, the logit ( ) function is the quantile function associated with the standard logistic distribution. It has many uses in data analysis and machine learning, especially in data transformations. Mathematically, the logit is the ...
for the first alternative (relative to the other alternative), measured in "logistic units" (or
logit In statistics, the logit ( ) function is the quantile function associated with the standard logistic distribution. It has many uses in data analysis and machine learning, especially in Data transformation (statistics), data transformations. Ma ...
s), is the
odds In probability theory, odds provide a measure of the probability of a particular outcome. Odds are commonly used in gambling and statistics. For example for an event that is 40% probable, one could say that the odds are or When gambling, o ...
for the first event (relative to the second), and, recalling that given odds of O = O:1 for ( against ), the probability is the ratio of for over (for plus against), O/(O+1), we see that e^x/(e^x + 1) = 1/(1 + e^) = p is the probability of the first alternative. Conversely, is the log-odds ''against'' the second alternative, is the log-odds ''for'' the second alternative, e^ is the odds for the second alternative, and e^/(e^ + 1) = 1/(1 + e^x) = q is the probability of the second alternative. This can be framed more symmetrically in terms of two inputs, and , which then generalizes naturally to more than two alternatives. Given two real number inputs, and , interpreted as logits, their ''difference'' x_1 - x_0 is the log-odds for option 1 (the log-odds ''against'' option 0), e^ is the odds, e^/(e^ + 1) = 1/\left(1 + e^\right) = e^/(e^ + e^) is the probability of option 1, and similarly e^/(e^ + e^) is the probability of option 0. This form immediately generalizes to more alternatives as the
softmax function The softmax function, also known as softargmax or normalized exponential function, converts a tuple of real numbers into a probability distribution of possible outcomes. It is a generalization of the logistic function to multiple dimensions, a ...
, which is a vector-valued function whose -th coordinate is e^ / \sum_^n e^. More subtly, the symmetric form emphasizes interpreting the input as x_1 - x_0 and thus ''relative'' to some reference point, implicitly to x_0 = 0. Notably, the softmax function is invariant under adding a constant to all the logits x_i, which corresponds to the difference x_j - x_i being the log-odds for option against option , but the individual logits x_i not being log-odds on their own. Often one of the options is used as a reference ("pivot"), and its value fixed as , so the other logits are interpreted as odds versus this reference. This is generally done with the first alternative, hence the choice of numbering: x_0 = 0, and then x_i = x_i - x_0 is the log-odds for option against option . Since e^0 = 1, this yields the +1 term in many expressions for the logistic function and generalizations.


Generalizations

In growth modeling, numerous generalizations exist, including the generalized logistic curve, the Gompertz function, the
cumulative distribution function In probability theory and statistics, the cumulative distribution function (CDF) of a real-valued random variable X, or just distribution function of X, evaluated at x, is the probability that X will take a value less than or equal to x. Ever ...
of the shifted Gompertz distribution, and the hyperbolastic function of type I. In statistics, where the logistic function is interpreted as the probability of one of two alternatives, the generalization to three or more alternatives is the
softmax function The softmax function, also known as softargmax or normalized exponential function, converts a tuple of real numbers into a probability distribution of possible outcomes. It is a generalization of the logistic function to multiple dimensions, a ...
, which is vector-valued, as it gives the probability of each alternative.


Applications


In ecology: modeling population growth

A typical application of the logistic equation is a common model of
population growth Population growth is the increase in the number of people in a population or dispersed group. The World population, global population has grown from 1 billion in 1800 to 8.2 billion in 2025. Actual global human population growth amounts to aroun ...
(see also
population dynamics Population dynamics is the type of mathematics used to model and study the size and age composition of populations as dynamical systems. Population dynamics is a branch of mathematical biology, and uses mathematical techniques such as differenti ...
), originally due to Pierre-François Verhulst in 1838, where the rate of reproduction is proportional to both the existing population and the amount of available resources, all else being equal. The Verhulst equation was published after Verhulst had read
Thomas Malthus Thomas Robert Malthus (; 13/14 February 1766 – 29 December 1834) was an English economist, cleric, and scholar influential in the fields of political economy and demography. In his 1798 book ''An Essay on the Principle of Population'', Mal ...
' ''
An Essay on the Principle of Population The book ''An Essay on the Principle of Population'' was first published anonymously in 1798, but the author was soon identified as Thomas Robert Malthus. The book warned of future difficulties, on an interpretation of the population increasing ...
'', which describes the
Malthusian growth model A Malthusian growth model, sometimes called a simple exponential growth model, is essentially exponential growth based on the idea of the function being proportional to the speed to which the function grows. The model is named after Thomas Robert ...
of simple (unconstrained) exponential growth. Verhulst derived his logistic equation to describe the self-limiting growth of a
biological Biology is the scientific study of life and living organisms. It is a broad natural science that encompasses a wide range of fields and unifying principles that explain the structure, function, growth, origin, evolution, and distribution of ...
population. The equation was rediscovered in 1911 by A. G. McKendrick for the growth of bacteria in broth and experimentally tested using a technique for nonlinear parameter estimation. The equation is also sometimes called the ''Verhulst-Pearl equation'' following its rediscovery in 1920 by Raymond Pearl (1879–1940) and Lowell Reed (1888–1966) of the
Johns Hopkins University The Johns Hopkins University (often abbreviated as Johns Hopkins, Hopkins, or JHU) is a private university, private research university in Baltimore, Maryland, United States. Founded in 1876 based on the European research institution model, J ...
. Another scientist, Alfred J. Lotka derived the equation again in 1925, calling it the ''law of population growth''. Letting P represent population size (N is often used in ecology instead) and t represent time, this model is formalized by the differential equation: \frac=r P \left(1 - \frac\right), where the constant r defines the growth rate and K is the
carrying capacity The carrying capacity of an ecosystem is the maximum population size of a biological species that can be sustained by that specific environment, given the food, habitat, water, and other resources available. The carrying capacity is defined as the ...
. In the equation, the early, unimpeded growth rate is modeled by the first term +rP. The value of the rate r represents the proportional increase of the population P in one unit of time. Later, as the population grows, the modulus of the second term (which multiplied out is -r P^2 / K) becomes almost as large as the first, as some members of the population P interfere with each other by competing for some critical resource, such as food or living space. This antagonistic effect is called the ''bottleneck'', and is modeled by the value of the parameter K. The competition diminishes the combined growth rate, until the value of P ceases to grow (this is called ''maturity'' of the population). The solution to the equation (with P_0 being the initial population) is P(t) = \frac = \frac, where \lim_ P(t) = K, where K is the limiting value of P, the highest value that the population can reach given infinite time (or come close to reaching in finite time). The carrying capacity is asymptotically reached independently of the initial value P(0) > 0, and also in the case that P(0) > K. In ecology,
species A species () is often defined as the largest group of organisms in which any two individuals of the appropriate sexes or mating types can produce fertile offspring, typically by sexual reproduction. It is the basic unit of Taxonomy (biology), ...
are sometimes referred to as r-strategist or K-strategist depending upon the selective processes that have shaped their life history strategies. Choosing the variable dimensions so that n measures the population in units of carrying capacity, and \tau measures time in units of 1/r, gives the dimensionless differential equation \frac = n (1-n).


Integral

The
antiderivative In calculus, an antiderivative, inverse derivative, primitive function, primitive integral or indefinite integral of a continuous function is a differentiable function whose derivative is equal to the original function . This can be stated ...
of the ecological form of the logistic function can be computed by the substitution u = K + P_0 \left( e^ - 1\right), since du = r P_0 e^ dt \int \frac\,dt = \int \frac \frac\,du = \frac \ln u + C = \frac \ln \left(K + P_0 (e^ - 1) \right) + C


Time-varying carrying capacity

Since the environmental conditions influence the carrying capacity, as a consequence it can be time-varying, with K(t) > 0, leading to the following mathematical model: \frac = rP \cdot \left(1 - \frac\right). A particularly important case is that of carrying capacity that varies periodically with period T: K(t + T) = K(t). It can be shown that in such a case, independently from the initial value P(0) > 0, P(t) will tend to a unique periodic solution P_*(t), whose period is T. A typical value of T is one year: In such case K(t) may reflect periodical variations of weather conditions. Another interesting generalization is to consider that the carrying capacity K(t) is a function of the population at an earlier time, capturing a delay in the way population modifies its environment. This leads to a logistic delay equation, which has a very rich behavior, with bistability in some parameter range, as well as a monotonic decay to zero, smooth exponential growth, punctuated unlimited growth (i.e., multiple S-shapes), punctuated growth or alternation to a stationary level, oscillatory approach to a stationary level, sustainable oscillations, finite-time singularities as well as finite-time death.


In statistics and machine learning

Logistic functions are used in several roles in statistics. For example, they are the
cumulative distribution function In probability theory and statistics, the cumulative distribution function (CDF) of a real-valued random variable X, or just distribution function of X, evaluated at x, is the probability that X will take a value less than or equal to x. Ever ...
of the logistic family of distributions, and they are, a bit simplified, used to model the chance a chess player has to beat their opponent in the
Elo rating system The Elo rating system is a method for calculating the relative skill levels of players in zero-sum games such as chess or esports. It is named after its creator Arpad Elo, a Hungarian-American chess master and physics professor. The Elo system wa ...
. More specific examples now follow.


Logistic regression

Logistic functions are used in
logistic regression In statistics, a logistic model (or logit model) is a statistical model that models the logit, log-odds of an event as a linear function (calculus), linear combination of one or more independent variables. In regression analysis, logistic regres ...
to model how the probability p of an event may be affected by one or more explanatory variables: an example would be to have the model p = f(a + bx), where x is the explanatory variable, a and b are model parameters to be fitted, and f is the standard logistic function. Logistic regression and other log-linear models are also commonly used in
machine learning Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of Computational statistics, statistical algorithms that can learn from data and generalise to unseen data, and thus perform Task ( ...
. A generalisation of the logistic function to multiple inputs is the
softmax activation function The softmax function, also known as softargmax or normalized exponential function, converts a tuple of real numbers into a probability distribution of possible outcomes. It is a generalization of the logistic function to multiple dimensions, a ...
, used in
multinomial logistic regression In statistics, multinomial logistic regression is a classification method that generalizes logistic regression to multiclass problems, i.e. with more than two possible discrete outcomes. That is, it is a model that is used to predict the prob ...
. Another application of the logistic function is in the
Rasch model The Rasch model, named after Georg Rasch, is a psychometric model for analyzing categorical data, such as answers to questions on a reading assessment or questionnaire responses, as a function of the trade-off between the respondent's abilities, ...
, used in
item response theory In psychometrics, item response theory (IRT, also known as latent trait theory, strong true score theory, or modern mental test theory) is a paradigm for the design, analysis, and scoring of Test (student assessment), tests, questionnaires, and sim ...
. In particular, the Rasch model forms a basis for
maximum likelihood In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed stati ...
estimation of the locations of objects or persons on a continuum, based on collections of
categorical data In statistics, a categorical variable (also called qualitative variable) is a variable (research), variable that can take on one of a limited, and usually fixed, number of possible values, assigning each individual or other unit of observation to a ...
, for example the abilities of persons on a continuum based on responses that have been categorized as correct and incorrect.


Neural networks

Logistic functions are often used in
artificial neural network In machine learning, a neural network (also artificial neural network or neural net, abbreviated ANN or NN) is a computational model inspired by the structure and functions of biological neural networks. A neural network consists of connected ...
s to introduce
nonlinearity In mathematics and science, a nonlinear system (or a non-linear system) is a system in which the change of the output is not proportional to the change of the input. Nonlinear problems are of interest to engineers, biologists, physicists, mathe ...
in the model or to clamp signals to within a specified interval. A popular neural net element computes a
linear combination In mathematics, a linear combination or superposition is an Expression (mathematics), expression constructed from a Set (mathematics), set of terms by multiplying each term by a constant and adding the results (e.g. a linear combination of ''x'' a ...
of its input signals, and applies a bounded logistic function as the
activation function The activation function of a node in an artificial neural network is a function that calculates the output of the node based on its individual inputs and their weights. Nontrivial problems can be solved using only a few nodes if the activation f ...
to the result; this model can be seen as a "smoothed" variant of the classical threshold neuron. A common choice for the activation or "squashing" functions, used to clip large magnitudes to keep the response of the neural network bounded,Gershenfeld 1999, p. 150. is g(h) = \frac, which is a logistic function. These relationships result in simplified implementations of
artificial neural network In machine learning, a neural network (also artificial neural network or neural net, abbreviated ANN or NN) is a computational model inspired by the structure and functions of biological neural networks. A neural network consists of connected ...
s with
artificial neuron An artificial neuron is a mathematical function conceived as a model of a biological neuron in a neural network. The artificial neuron is the elementary unit of an ''artificial neural network''. The design of the artificial neuron was inspired ...
s. Practitioners caution that sigmoidal functions which are antisymmetric about the origin (e.g. the hyperbolic tangent) lead to faster convergence when training networks with
backpropagation In machine learning, backpropagation is a gradient computation method commonly used for training a neural network to compute its parameter updates. It is an efficient application of the chain rule to neural networks. Backpropagation computes th ...
. The logistic function is itself the derivative of another proposed activation function, the softplus.


In medicine: modeling of growth of tumors

Another application of logistic curve is in medicine, where the logistic differential equation can be used to model the growth of
tumors A neoplasm () is a type of abnormal and excessive growth of tissue. The process that occurs to form or produce a neoplasm is called neoplasia. The growth of a neoplasm is uncoordinated with that of the normal surrounding tissue, and persists ...
. This application can be considered an extension of the above-mentioned use in the framework of ecology (see also the Generalized logistic curve, allowing for more parameters). Denoting with X(t) the size of the tumor at time t, its dynamics are governed by X' = r\left(1 - \frac X K \right)X, which is of the type X' = F(X)X, \quad F'(X) \le 0, where F(X) is the proliferation rate of the tumor. If a course of
chemotherapy Chemotherapy (often abbreviated chemo, sometimes CTX and CTx) is the type of cancer treatment that uses one or more anti-cancer drugs (list of chemotherapeutic agents, chemotherapeutic agents or alkylating agents) in a standard chemotherapy re ...
is started with a log-kill effect, the equation may be revised to be X' = r\left(1 - \frac X K \right)X - c(t) X, where c(t) is the therapy-induced death rate. In the idealized case of very long therapy, c(t) can be modeled as a periodic function (of period T) or (in case of continuous infusion therapy) as a constant function, and one has that \frac 1 T \int_0^T c(t)\, dt > r \to \lim_ x(t) = 0, i.e. if the average therapy-induced death rate is greater than the baseline proliferation rate, then there is the eradication of the disease. Of course, this is an oversimplified model of both the growth and the therapy. For example, it does not take into account the evolution of clonal resistance, or the side-effects of the therapy on the patient. These factors can result in the eventual failure of chemotherapy, or its discontinuation.


In medicine: modeling of a pandemic

A novel infectious pathogen to which a population has no immunity will generally spread exponentially in the early stages, while the supply of susceptible individuals is plentiful. The SARS-CoV-2 virus that causes
COVID-19 Coronavirus disease 2019 (COVID-19) is a contagious disease caused by the coronavirus SARS-CoV-2. In January 2020, the disease spread worldwide, resulting in the COVID-19 pandemic. The symptoms of COVID‑19 can vary but often include fever ...
exhibited exponential growth early in the course of infection in several countries in early 2020. Factors including a lack of susceptible hosts (through the continued spread of infection until it passes the threshold for
herd immunity Herd immunity (also called herd effect, community immunity, population immunity, or mass immunity) is a form of indirect protection that applies only to contagious diseases. It occurs when a sufficient percentage of a population has become i ...
) or reduction in the accessibility of potential hosts through physical distancing measures, may result in exponential-looking epidemic curves first linearizing (replicating the "logarithmic" to "logistic" transition first noted by Pierre-François Verhulst, as noted above) and then reaching a maximal limit. A logistic function, or related functions (e.g. the Gompertz function) are usually used in a descriptive or phenomenological manner because they fit well not only to the early exponential rise, but to the eventual levelling off of the pandemic as the population develops a herd immunity. This is in contrast to actual models of pandemics which attempt to formulate a description based on the dynamics of the pandemic (e.g. contact rates, incubation times, social distancing, etc.). Some simple models have been developed, however, which yield a logistic solution.


Modeling early COVID-19 cases

A generalized logistic function, also called the Richards growth curve, has been applied to model the early phase of the
COVID-19 Coronavirus disease 2019 (COVID-19) is a contagious disease caused by the coronavirus SARS-CoV-2. In January 2020, the disease spread worldwide, resulting in the COVID-19 pandemic. The symptoms of COVID‑19 can vary but often include fever ...
outbreak. The authors fit the generalized logistic function to the cumulative number of infected cases, here referred to as ''infection trajectory''. There are different parameterizations of the generalized logistic function in the literature. One frequently used forms is f(t ; \theta_1,\theta_2,\theta_3, \xi) = \frac where \theta_1,\theta_2,\theta_3 are real numbers, and \xi is a positive real number. The flexibility of the curve f is due to the parameter \xi : (i) if \xi = 1 then the curve reduces to the logistic function, and (ii) as \xi approaches zero, the curve converges to the Gompertz function. In epidemiological modeling, \theta_1, \theta_2, and \theta_3 represent the final epidemic size, infection rate, and lag phase, respectively. See the right panel for an example infection trajectory when (\theta_1,\theta_2,\theta_3) is set to (10000,0.2,40). One of the benefits of using a growth function such as the generalized logistic function in epidemiological modeling is its relatively easy application to the
multilevel model Multilevel models are statistical models of parameters that vary at more than one level. An example could be a model of student performance that contains measures for individual students as well as measures for classrooms within which the studen ...
framework, where information from different geographic regions can be pooled together.


In chemistry: reaction models

The concentration of reactants and products in autocatalytic reactions follow the logistic function. The degradation of
Platinum group The platinum-group metals (PGMs) are six noble, precious metallic elements clustered together in the periodic table. These elements are all transition metals in the d-block (groups 8, 9, and 10, periods 5 and 6). The six platinum-group ...
metal-free (PGM-free) oxygen reduction reaction (ORR) catalyst in fuel cell cathodes follows the logistic decay function, suggesting an autocatalytic degradation mechanism.


In physics: Fermi–Dirac distribution

The logistic function determines the statistical distribution of fermions over the energy states of a system in thermal equilibrium. In particular, it is the distribution of the probabilities that each possible energy level is occupied by a fermion, according to
Fermi–Dirac statistics Fermi–Dirac statistics is a type of quantum statistics that applies to the physics of a system consisting of many non-interacting, identical particles that obey the Pauli exclusion principle. A result is the Fermi–Dirac distribution of part ...
.


In optics: mirage

The logistic function also finds applications in optics, particularly in modelling phenomena such as mirages. Under certain conditions, such as the presence of a temperature or concentration gradient due to diffusion and balancing with gravity, logistic curve behaviours can emerge. A mirage, resulting from a temperature gradient that modifies the refractive index related to the density/concentration of the material over distance, can be modelled using a fluid with a refractive index gradient due to the concentration gradient. This mechanism can be equated to a limiting population growth model, where the concentrated region attempts to diffuse into the lower concentration region, while seeking equilibrium with gravity, thus yielding a logistic function curve.


In material science: phase diagrams

See Diffusion bonding.


In linguistics: language change

In linguistics, the logistic function can be used to model
language change Language change is the process of alteration in the features of a single language, or of languages in general, over time. It is studied in several subfields of linguistics: historical linguistics, sociolinguistics, and evolutionary linguistic ...
:Bod, Hay, Jennedy (eds.) 2003, pp. 147–156 an innovation that is at first marginal begins to spread more quickly with time, and then more slowly as it becomes more universally adopted.


In agriculture: modeling crop response

The logistic S-curve can be used for modeling the crop response to changes in growth factors. There are two types of response functions: ''positive'' and ''negative'' growth curves. For example, the crop yield may ''increase'' with increasing value of the growth factor up to a certain level (positive function), or it may ''decrease'' with increasing growth factor values (negative function owing to a negative growth factor), which situation requires an ''inverted'' S-curve.


In economics and sociology: diffusion of innovations

The logistic function can be used to illustrate the progress of the diffusion of an innovation through its life cycle. In ''The Laws of Imitation'' (1890), Gabriel Tarde describes the rise and spread of new ideas through imitative chains. In particular, Tarde identifies three main stages through which innovations spread: the first one corresponds to the difficult beginnings, during which the idea has to struggle within a hostile environment full of opposing habits and beliefs; the second one corresponds to the properly exponential take-off of the idea, with f(x)=2^x; finally, the third stage is logarithmic, with f(x)=\log(x), and corresponds to the time when the impulse of the idea gradually slows down while, simultaneously new opponent ideas appear. The ensuing situation halts or stabilizes the progress of the innovation, which approaches an asymptote. In a
sovereign state A sovereign state is a State (polity), state that has the highest authority over a territory. It is commonly understood that Sovereignty#Sovereignty and independence, a sovereign state is independent. When referring to a specific polity, the ter ...
, the subnational units (constituent states or cities) may use loans to finance their projects. However, this funding source is usually subject to strict legal rules as well as to economy
scarcity In economics, scarcity "refers to the basic fact of life that there exists only a finite amount of human and nonhuman resources which the best technical knowledge is capable of using to produce only limited maximum amounts of each economic good. ...
constraints, especially the resources the banks can lend (due to their equity or
Basel Basel ( ; ), also known as Basle ( ), ; ; ; . is a city in northwestern Switzerland on the river Rhine (at the transition from the High Rhine, High to the Upper Rhine). Basel is Switzerland's List of cities in Switzerland, third-most-populo ...
limits). These restrictions, which represent a saturation level, along with an exponential rush in an economic competition for money, create a
public finance Public finance refers to the monetary resources available to governments and also to the study of finance within government and role of the government in the economy. Within academic settings, public finance is a widely studied subject in man ...
diffusion of credit pleas and the aggregate national response is a sigmoid curve. Historically, when new products are introduced there is an intense amount of
research and development Research and development (R&D or R+D), known in some countries as OKB, experiment and design, is the set of innovative activities undertaken by corporations or governments in developing new services or products. R&D constitutes the first stage ...
which leads to dramatic improvements in quality and reductions in cost. This leads to a period of rapid industry growth. Some of the more famous examples are: railroads, incandescent light bulbs,
electrification Electrification is the process of powering by electricity and, in many contexts, the introduction of such power by changing over from an earlier power source. In the context of history of technology and economic development, electrification refe ...
, cars and air travel. Eventually, dramatic improvement and cost reduction opportunities are exhausted, the product or process are in widespread use with few remaining potential new customers, and markets become saturated. Logistic analysis was used in papers by several researchers at the International Institute of Applied Systems Analysis ( IIASA). These papers deal with the diffusion of various innovations, infrastructures and energy source substitutions and the role of work in the economy as well as with the long economic cycle. Long economic cycles were investigated by Robert Ayres (1989). Cesare Marchetti published on long economic cycles and on diffusion of innovations. Arnulf Grübler's book (1990) gives a detailed account of the diffusion of infrastructures including canals, railroads, highways and airlines, showing that their diffusion followed logistic shaped curves. Carlota Perez used a logistic curve to illustrate the long ( Kondratiev) business cycle with the following labels: beginning of a technological era as ''irruption'', the ascent as ''frenzy'', the rapid build out as ''synergy'' and the completion as ''maturity''.


Inflection Point Determination in Logistic Growth Regression

Logistic growth regressions carry significant uncertainty when data is available only up to around the inflection point of the growth process. Under these conditions, estimating the height at which the inflection point will occur may have uncertainties comparable to the carrying capacity (K) of the system. A method to mitigate this uncertainty involves using the carrying capacity from a surrogate logistic growth process as a reference point. By incorporating this constraint, even if K is only an estimate within a factor of two, the regression is stabilized, which improves accuracy and reduces uncertainty in the prediction parameters. This approach can be applied in fields such as economics and biology, where analogous surrogate systems or populations are available to inform the analysis.


Sequential analysis

Link created an extension of Wald's theory of sequential analysis to a distribution-free accumulation of random variables until either a positive or negative bound is first equaled or exceeded. Link derives the probability of first equaling or exceeding the positive boundary as 1/(1+e^), the logistic function. This is the first proof that the logistic function may have a stochastic process as its basis. LinkS. W. Link, The wave theory of difference and similarity (book), Taylor and Francis, 1992 provides a century of examples of "logistic" experimental results and a newly derived relation between this probability and the time of absorption at the boundaries.


See also

* Cross fluid * Hyperbolic growth *
Heaviside step function The Heaviside step function, or the unit step function, usually denoted by or (but sometimes , or ), is a step function named after Oliver Heaviside, the value of which is zero for negative arguments and one for positive arguments. Differen ...
* Hill equation (biochemistry) * Hubbert curve * List of mathematical functions * STAR model *
Michaelis–Menten kinetics In biochemistry, Michaelis–Menten kinetics, named after Leonor Michaelis and Maud Menten, is the simplest case of enzyme kinetics, applied to enzyme-catalysed reactions involving the transformation of one substrate into one product. It takes th ...
* ''r''/''K'' selection theory *
Rectifier (neural networks) In the context of Neural network (machine learning), artificial neural networks, the rectifier or ReLU (rectified linear unit) activation function is an activation function defined as the non-negative part of its argument, i.e., the ramp function ...
* Shifted Gompertz distribution *
Tipping point (sociology) In sociology, a tipping point is a point in time when a group—or many group members—rapidly and dramatically changes its behavior by widely adopting a previously rare practice. History The phrase was first used in sociology by Morton Grod ...


Notes


References

* ** Published as: * * * *


External links

* L.J. Linacre
Why logistic ogive and not autocatalytic curve?
accessed 2009-09-12. * https://web.archive.org/web/20060914155939/http://luna.cas.usf.edu/~mbrannic/files/regression/Logistic.html * {{MathWorld , title=Sigmoid Function , urlname= SigmoidFunction
Online experiments with JSXGraph



Seeing the s-curve in everything.

Restricted Logarithmic Growth with Injection
Special functions Differential equations Population dynamics Population ecology Logistic regression Growth curves