In
probability theory
Probability theory or probability calculus is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expre ...
, a piecewise-deterministic Markov process (PDMP) is a process whose behaviour is governed by random jumps at points in time, but whose evolution is deterministically governed by an
ordinary differential equation
In mathematics, an ordinary differential equation (ODE) is a differential equation (DE) dependent on only a single independent variable (mathematics), variable. As with any other DE, its unknown(s) consists of one (or more) Function (mathematic ...
between those times. The class of models is "wide enough to include as special cases virtually all the non-diffusion models of
applied probability
Applied probability is the application of probability theory to statistical problems and other scientific and engineering domains.
Scope
Much research involving probability is done under the auspices of applied probability. However, while such re ...
."
The process is defined by three quantities: the flow, the jump rate, and the transition measure.
The model was first introduced in a paper by
Mark H. A. Davis in 1984.
Examples
Piecewise linear models such as
Markov chain
In probability theory and statistics, a Markov chain or Markov process is a stochastic process describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally ...
s,
continuous-time Markov chain
A continuous-time Markov chain (CTMC) is a continuous stochastic process in which, for each state, the process will change state according to an exponential random variable and then move to a different state as specified by the probabilities of a ...
s, the
M/G/1 queue
In queueing theory, a discipline within the mathematical theory of probability, an M/G/1 queue is a queue model where arrivals are Markovian (modulated by a Poisson process), service times have a General distribution and there is a single server. ...
, the
GI/G/1 queue and the
fluid queue In queueing theory, a discipline within the mathematical theory of probability, a fluid queue (fluid model, fluid flow model or stochastic fluid model) is a mathematical model used to describe the fluid level in a reservoir subject to randomly deter ...
can be encapsulated as PDMPs with simple differential equations.
Applications
PDMPs have been shown useful in
ruin theory
In actuarial science and applied probability, ruin theory (sometimes risk theory or collective risk theory) uses mathematical models to describe an insurer's vulnerability to insolvency/ruin. In such models key quantities of interest are the proba ...
,
queueing theory
Queueing theory is the mathematical study of waiting lines, or queues. A queueing model is constructed so that queue lengths and waiting time can be predicted. Queueing theory is generally considered a branch of operations research because th ...
, for modelling
biochemical processes
Biochemistry, or biological chemistry, is the study of chemical processes within and relating to living organisms. A sub-discipline of both chemistry and biology, biochemistry may be divided into three fields: structural biology, enzymology, a ...
such as DNA replication in
eukaryotes
The eukaryotes ( ) constitute the domain of Eukaryota or Eukarya, organisms whose cells have a membrane-bound nucleus. All animals, plants, fungi, seaweeds, and many unicellular organisms are eukaryotes. They constitute a major group of ...
and subtilin production by the organism
B. subtilis, and for modelling
earthquake
An earthquakealso called a quake, tremor, or tembloris the shaking of the Earth's surface resulting from a sudden release of energy in the lithosphere that creates seismic waves. Earthquakes can range in intensity, from those so weak they ...
s. Moreover, this class of processes has been shown to be appropriate for biophysical neuron models with stochastic ion channels.
Properties
Löpker and Palmowski have shown conditions under which a
time reversed PDMP is a PDMP. General conditions are known for PDMPs to be stable.
Galtier et al. studied the law of the trajectories of PDMP and provided a reference measure in order to express a density of a trajectory of the PDMP. Their work opens the way to any application using densities of trajectory. (For instance, they used the density of a trajectories to perform
importance sampling
Importance sampling is a Monte Carlo method for evaluating properties of a particular distribution, while only having samples generated from a different distribution than the distribution of interest. Its introduction in statistics is generally at ...
, this work was further developed by Chennetier and Al.
to estimate the reliability of industrial systems.)
See also
*
Jump diffusion
Jump diffusion is a stochastic process that involves jump process, jumps and diffusion process, diffusion. It has important applications in magnetic reconnection, coronal mass ejections, condensed matter physics, and pattern theory and computationa ...
, a generalization of piecewise-deterministic Markov processes
*
Hybrid system
A hybrid system is a dynamical system that exhibits both continuous and discrete dynamic behavior – a system that can both ''flow'' (described by a differential equation) and ''jump'' (described by a state machine, automaton, or a differ ...
(in the context of
dynamical system
In mathematics, a dynamical system is a system in which a Function (mathematics), function describes the time dependence of a Point (geometry), point in an ambient space, such as in a parametric curve. Examples include the mathematical models ...
s), a broad class of dynamical systems that includes all jump diffusions (and hence all piecewise-deterministic Markov processes)
References
{{reflist
Markov processes