Asymmetric Laplace Distribution
   HOME

TheInfoList



OR:

In
probability theory Probability theory or probability calculus is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expre ...
and
statistics Statistics (from German language, German: ', "description of a State (polity), state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a s ...
, the asymmetric Laplace distribution (ALD) is a continuous
probability distribution In probability theory and statistics, a probability distribution is a Function (mathematics), function that gives the probabilities of occurrence of possible events for an Experiment (probability theory), experiment. It is a mathematical descri ...
which is a generalization of the
Laplace distribution In probability theory and statistics, the Laplace distribution is a continuous probability distribution named after Pierre-Simon Laplace. It is also sometimes called the double exponential distribution, because it can be thought of as two exponen ...
. Just as the Laplace distribution consists of two
exponential distribution In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the distance between events in a Poisson point process, i.e., a process in which events occur continuousl ...
s of equal scale back-to-back about ''x'' = ''m'', the asymmetric Laplace consists of two exponential distributions of unequal scale back to back about ''x'' = ''m'', adjusted to assure continuity and normalization. The difference of two variates
exponentially distributed In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the distance between events in a Poisson point process, i.e., a process in which events occur continuous ...
with different means and rate parameters will be distributed according to the ALD. When the two rate parameters are equal, the difference will be distributed according to the Laplace distribution.


Characterization


Probability density function

A
random variable A random variable (also called random quantity, aleatory variable, or stochastic variable) is a Mathematics, mathematical formalization of a quantity or object which depends on randomness, random events. The term 'random variable' in its mathema ...
has an asymmetric Laplace(''m'', ''λ'', ''κ'') distribution if its
probability density function In probability theory, a probability density function (PDF), density function, or density of an absolutely continuous random variable, is a Function (mathematics), function whose value at any given sample (or point) in the sample space (the s ...
is :f(x;m,\lambda,\kappa)=\left(\frac\right)\, e^ where ''s''= sgn''(x-m)'', or alternatively: : f(x;m,\lambda,\kappa) = \frac \begin \exp \left( (\lambda/\kappa)(x-m) \right) & \textx < m \\ pt \exp ( -\lambda\kappa(x-m) ) & \textx \geq m \end Here, ''m'' is a
location parameter In statistics, a location parameter of a probability distribution is a scalar- or vector-valued parameter x_0, which determines the "location" or shift of the distribution. In the literature of location parameter estimation, the probability distr ...
, ''λ'' > 0 is a
scale parameter In probability theory and statistics, a scale parameter is a special kind of numerical parameter of a parametric family of probability distributions. The larger the scale parameter, the more spread out the distribution. Definition If a family ...
, and ''κ'' is an
asymmetry Asymmetry is the absence of, or a violation of, symmetry (the property of an object being invariant to a transformation, such as reflection). Symmetry is an important property of both physical and abstract systems and it may be displayed in pre ...
parameter. When ''κ'' = 1, ''(x-m)s κs'' simplifies to '', x-m, '' and the distribution simplifies to the
Laplace distribution In probability theory and statistics, the Laplace distribution is a continuous probability distribution named after Pierre-Simon Laplace. It is also sometimes called the double exponential distribution, because it can be thought of as two exponen ...
.


Cumulative distribution function

The
cumulative distribution function In probability theory and statistics, the cumulative distribution function (CDF) of a real-valued random variable X, or just distribution function of X, evaluated at x, is the probability that X will take a value less than or equal to x. Ever ...
is given by: : F(x;m,\lambda,\kappa) = \begin \frac\exp ((\lambda/\kappa)(x-m)) & \textx \leq m \\ pt 1-\frac \exp (-\lambda\kappa(x-m)) & \textx > m \end


Characteristic function

The ALD characteristic function is given by: :\varphi(t;m,\lambda,\kappa)=\frac For ''m'' = 0, the ALD is a member of the family of
geometric stable distribution A geometric stable distribution or geo-stable distribution is a type of leptokurtic probability distribution. Geometric stable distributions were introduced in Klebanov, L. B., Maniya, G. M., and Melamed, I. A. (1985). A problem of Zolotarev and ...
s with ''α'' = 2. It follows that if \varphi_1 and \varphi_2 are two distinct ALD characteristic functions with ''m'' = 0, then :\varphi=\frac is also an ALD characteristic function with location parameter m=0. The new scale parameter ''λ'' obeys :\frac=\frac+\frac and the new skewness parameter ''κ'' obeys: :\frac=\frac+\frac


Moments, mean, variance, skewness

The ''n''-th moment of the ALD about ''m'' is given by : E x-m)^n\frac\,(\kappa^-(-\kappa)^) From the
binomial theorem In elementary algebra, the binomial theorem (or binomial expansion) describes the algebraic expansion of powers of a binomial. According to the theorem, the power expands into a polynomial with terms of the form , where the exponents and a ...
, the ''n''-th moment about zero (for ''m'' not zero) is then: : E ^n\frac\,\left( \sum_^n\frac\,\frac -\sum_^n\frac\,\frac \right) := \frac \left( e^ E_(m \lambda\kappa ) -e^ E_(-m \lambda /\kappa) \right) where E_n( ) is the generalized
exponential integral In mathematics, the exponential integral Ei is a special function on the complex plane. It is defined as one particular definite integral of the ratio between an exponential function and its argument. Definitions For real non-zero values of&nb ...
function E_n(x)=x^\Gamma(1-n,x) The first moment about zero is the mean: :\mu=E m-\frac The variance is: :\sigma^2=E ^2\mu^2=\frac and the skewness is: :\frac=\frac


Generating asymmetric Laplace variates

Asymmetric Laplace variates (''X'') may be generated from a random variate ''U'' drawn from the uniform distribution in the interval (-κ,1/κ) by: : X=m-\frac\log(1-U\,s\kappa^S) where s=sgn(U). They may also be generated as the difference of two
exponential distribution In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the distance between events in a Poisson point process, i.e., a process in which events occur continuousl ...
s. If ''X1'' is drawn from exponential distribution with mean and rate (''m1'',λ/κ) and ''X2'' is drawn from an exponential distribution with mean and rate (''m2'',λκ) then ''X1 - X2'' is distributed according to the asymmetric Laplace distribution with parameters (''m1-m2'', λ, κ)


Entropy

The differential
entropy Entropy is a scientific concept, most commonly associated with states of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the micros ...
of the ALD is : H=-\int_^\infty f_(x)\log(f_(x)) dx = 1-\log\left(\frac\right) The ALD has the maximum entropy of all distributions with a fixed value (1/λ) of (x-m)\,s\kappa^s where s=\sgn(x-m).


Alternative parametrization

An alternative parametrization is made possible by the characteristic function: \varphi(t;\mu,\sigma,\beta)=\frac where \mu is a
location parameter In statistics, a location parameter of a probability distribution is a scalar- or vector-valued parameter x_0, which determines the "location" or shift of the distribution. In the literature of location parameter estimation, the probability distr ...
, \sigma is a
scale parameter In probability theory and statistics, a scale parameter is a special kind of numerical parameter of a parametric family of probability distributions. The larger the scale parameter, the more spread out the distribution. Definition If a family ...
, \beta is an
asymmetry Asymmetry is the absence of, or a violation of, symmetry (the property of an object being invariant to a transformation, such as reflection). Symmetry is an important property of both physical and abstract systems and it may be displayed in pre ...
parameter. This is specified in Section 2.6.1 and Section 3.1 of Lihn (2015). Its
probability density function In probability theory, a probability density function (PDF), density function, or density of an absolutely continuous random variable, is a Function (mathematics), function whose value at any given sample (or point) in the sample space (the s ...
is : f(x;\mu,\sigma,\beta) = \frac \begin \exp \left( \frac \right) & \textx < \mu \\ pt \exp ( -\frac ) & \textx \geq \mu \end where B_0=\sqrt and B^\pm=B_0\pm\beta/2 . It follows that B^+ B^- = 1,\P B^+ - B^- = \beta . The ''n''-th moment about \mu is given by : E x-\mu)^n\frac ( (B^+)^ + (-1)^n (B^-)^ ) The mean about zero is:The variance is:The skewness is:The excess kurtosis is:For small \beta, the skewness is about 3\beta/\sqrt . Thus \beta represents skewness in an almost direct way.


Alternative parameterization for Bayesian quantile regression

The Asymmetric Laplace distribution is commonly used with an alternative parameterization for performing
quantile regression Quantile regression is a type of regression analysis used in statistics and econometrics. Whereas the method of least squares estimates the conditional ''mean'' of the response variable across values of the predictor variables, quantile regress ...
in a
Bayesian inference Bayesian inference ( or ) is a method of statistical inference in which Bayes' theorem is used to calculate a probability of a hypothesis, given prior evidence, and update it as more information becomes available. Fundamentally, Bayesian infer ...
context. Under this approach, the \kappa parameter describing asymmetry is replaced with a p parameter indicating the percentile or quantile desired. Using this parameterization, the likelihood of the Asymmetric Laplace Distribution is equivalent to the loss function employed in
quantile regression Quantile regression is a type of regression analysis used in statistics and econometrics. Whereas the method of least squares estimates the conditional ''mean'' of the response variable across values of the predictor variables, quantile regress ...
. With this alternative parameterization, the
probability density function In probability theory, a probability density function (PDF), density function, or density of an absolutely continuous random variable, is a Function (mathematics), function whose value at any given sample (or point) in the sample space (the s ...
is defined as: : f(x;m,\lambda,p) = \frac \begin \exp \left( -((p-1)/\lambda)(x-m) \right) & \textx \leq m \\ pt \exp ( -(p/\lambda)(x-m) ) & \textx > m \end Where, ''m'' is a
location parameter In statistics, a location parameter of a probability distribution is a scalar- or vector-valued parameter x_0, which determines the "location" or shift of the distribution. In the literature of location parameter estimation, the probability distr ...
, ''λ'' > 0 is a
scale parameter In probability theory and statistics, a scale parameter is a special kind of numerical parameter of a parametric family of probability distributions. The larger the scale parameter, the more spread out the distribution. Definition If a family ...
, and ''0 < p < 1'' is a
percentile In statistics, a ''k''-th percentile, also known as percentile score or centile, is a score (e.g., a data point) a given percentage ''k'' of all scores in its frequency distribution exists ("exclusive" definition) or a score a given percentage ...
parameter. The mean (\mu) and variance (\sigma^2) are calculated as: :\mu=m+\frac\lambda :\sigma^2=\frac\lambda^2 The
cumulative distribution function In probability theory and statistics, the cumulative distribution function (CDF) of a real-valued random variable X, or just distribution function of X, evaluated at x, is the probability that X will take a value less than or equal to x. Ever ...
is given by: : F(x;m,\lambda,p) = \begin p\exp (\frac(x-m)) & \textx \leq m \\ pt 1-(1-p) \exp (\frac(x-m)) & \textx > m \end


Applications

The asymmetric Laplace distribution has applications in finance and neuroscience. For the example in finance, S.G. Kou developed a model for financial instrument prices incorporating an asymmetric Laplace distribution to address problems of
skewness In probability theory and statistics, skewness is a measure of the asymmetry of the probability distribution of a real-valued random variable about its mean. The skewness value can be positive, zero, negative, or undefined. For a unimodal ...
,
kurtosis In probability theory and statistics, kurtosis (from , ''kyrtos'' or ''kurtos'', meaning "curved, arching") refers to the degree of “tailedness” in the probability distribution of a real-valued random variable. Similar to skewness, kurtos ...
and the
volatility smile Volatility smiles are implied volatility patterns that arise in pricing financial options. It is a parameter (implied volatility) that is needed to be modified for the Black–Scholes formula to fit market prices. In particular for a given ex ...
that often occur when using a normal distribution for pricing these instruments. Another example is in neuroscience in which its convolution with normal distribution is considered as a model for brain stopping reaction times.


References

{{DEFAULTSORT:Asymmetric Laplace Distribution Continuous distributions Exponential family distributions Location-scale family probability distributions Geometric stable distributions