Magnus Expansion
   HOME

TheInfoList



OR:

In
mathematics Mathematics is a field of study that discovers and organizes methods, Mathematical theory, theories and theorems that are developed and Mathematical proof, proved for the needs of empirical sciences and mathematics itself. There are many ar ...
and
physics Physics is the scientific study of matter, its Elementary particle, fundamental constituents, its motion and behavior through space and time, and the related entities of energy and force. "Physical science is that department of knowledge whi ...
, the Magnus expansion, named after
Wilhelm Magnus Hans Heinrich Wilhelm Magnus, known as Wilhelm Magnus (5 February 1907 in Berlin, Germany – 15 October 1990 in New Rochelle, New York), was a German-American mathematician. He made important contributions in combinatorial group theory, Lie algeb ...
(1907–1990), provides an exponential representation of the
product integral A product integral is any product-based counterpart of the usual sum-based integral of calculus. The product integral was developed by the mathematician Vito Volterra in 1887 to solve systems of linear differential equations. A. Slavík''Product ...
solution of a first-order homogeneous
linear differential equation In mathematics, a linear differential equation is a differential equation that is linear equation, linear in the unknown function and its derivatives, so it can be written in the form a_0(x)y + a_1(x)y' + a_2(x)y'' \cdots + a_n(x)y^ = b(x) wher ...
for a
linear operator In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that pr ...
. In particular, it furnishes the fundamental matrix of a system of linear
ordinary differential equations In mathematics, an ordinary differential equation (ODE) is a differential equation (DE) dependent on only a single independent variable. As with any other DE, its unknown(s) consists of one (or more) function(s) and involves the derivatives ...
of order with varying coefficients. The exponent is aggregated as an infinite series, whose terms involve multiple integrals and nested commutators.


The deterministic case


Magnus approach and its interpretation

Given the coefficient matrix , one wishes to solve the initial-value problem associated with the linear ordinary differential equation : Y'(t) = A(t) Y(t), \quad Y(t_0) = Y_0 for the unknown -dimensional vector function . When ''n'' = 1, the solution is given as a
product integral A product integral is any product-based counterpart of the usual sum-based integral of calculus. The product integral was developed by the mathematician Vito Volterra in 1887 to solve systems of linear differential equations. A. Slavík''Product ...
: Y(t) = \exp \left( \int_^t A(s)\,ds \right) Y_0. This is still valid for ''n'' > 1 if the matrix satisfies for any pair of values of ''t'', ''t''1 and ''t''2. In particular, this is the case if the matrix is independent of . In the general case, however, the expression above is no longer the solution of the problem. The approach introduced by Magnus to solve the matrix initial-value problem is to express the solution by means of the exponential of a certain matrix function : : Y(t) = \exp\big(\Omega(t, t_0)\big) \, Y_0, which is subsequently constructed as a
series Series may refer to: People with the name * Caroline Series (born 1951), English mathematician, daughter of George Series * George Series (1920–1995), English physicist Arts, entertainment, and media Music * Series, the ordered sets used i ...
expansion: : \Omega(t) = \sum_^\infty \Omega_k(t), where, for simplicity, it is customary to write for and to take ''t''0 = 0. Magnus appreciated that, since , using a Poincaré−Hausdorff matrix identity, he could relate the time derivative of to the generating function of
Bernoulli numbers In mathematics, the Bernoulli numbers are a sequence of rational numbers which occur frequently in analysis. The Bernoulli numbers appear in (and can be defined by) the Taylor series expansions of the tangent and hyperbolic tangent functions, ...
and the
adjoint endomorphism In mathematics, the adjoint representation (or adjoint action) of a Lie group ''G'' is a way of representing the elements of the group as linear transformations of the group's Lie algebra, considered as a vector space. For example, if ''G'' is \m ...
of , : \Omega' = \frac A, to solve for recursively in terms of "in a continuous analog of the BCH expansion", as outlined in a subsequent section. The equation above constitutes the Magnus expansion, or Magnus series, for the solution of matrix linear initial-value problem. The first four terms of this series read : \begin \Omega_1(t) &= \int_0^t A(t_1)\,dt_1, \\ \Omega_2(t) &= \frac \int_0^t dt_1 \int_0^ dt_2 \, (t_1), A(t_2) \\ \Omega_3(t) &= \frac \int_0^t dt_1 \int_0^ dt_2 \int_0^ dt_3 \, \Bigl(\big (t_1), [A(t_2), A(t_3)big">(t_2),_A(t_3).html" ;"title="(t_1), [A(t_2), A(t_3)">(t_1), [A(t_2), A(t_3)big+ \big[A(t_3), [A(t_2), A(t_1)]\big]\Bigr), \\ \Omega_4(t) &= \frac \int_0^t dt_1 \int_0^d t_2 \int_0^ dt_3 \int_0^ dt_4\, \left(\Big[\bigA_1, A_2], A_3\big], A_4\Big]\right. \\ &\qquad + \Big[A_1, \big A_2, A_3 A_4\big]\Big] + \Big _1, \big[A_2, [A_3, A_4big">_2,_[A_3,_A_4.html" ;"title="_1, \big[A_2, [A_3, A_4">_1, \big[A_2, [A_3, A_4bigBig] +\left. \Big[A_2, \big[A_3, [A_4, A_1]\big]\Big]\right), \end where is the matrix commutator of ''A'' and ''B''. These equations may be interpreted as follows: coincides exactly with the exponent in the scalar ( = 1) case, but this equation cannot give the whole solution. If one insists in having an exponential representation (
Lie group In mathematics, a Lie group (pronounced ) is a group (mathematics), group that is also a differentiable manifold, such that group multiplication and taking inverses are both differentiable. A manifold is a space that locally resembles Eucli ...
), the exponent needs to be corrected. The rest of the Magnus series provides that correction systematically: or parts of it are in the
Lie algebra In mathematics, a Lie algebra (pronounced ) is a vector space \mathfrak g together with an operation called the Lie bracket, an alternating bilinear map \mathfrak g \times \mathfrak g \rightarrow \mathfrak g, that satisfies the Jacobi ident ...
of the
Lie group In mathematics, a Lie group (pronounced ) is a group (mathematics), group that is also a differentiable manifold, such that group multiplication and taking inverses are both differentiable. A manifold is a space that locally resembles Eucli ...
on the solution. In applications, one can rarely sum exactly the Magnus series, and one has to truncate it to get approximate solutions. The main advantage of the Magnus proposal is that the truncated series very often shares important qualitative properties with the exact solution, at variance with other conventional
perturbation Perturbation or perturb may refer to: * Perturbation theory, mathematical methods that give approximate solutions to problems that cannot be solved exactly * Perturbation (geology), changes in the nature of alluvial deposits over time * Perturbati ...
theories. For instance, in
classical mechanics Classical mechanics is a Theoretical physics, physical theory describing the motion of objects such as projectiles, parts of Machine (mechanical), machinery, spacecraft, planets, stars, and galaxies. The development of classical mechanics inv ...
the symplectic character of the
time evolution Time evolution is the change of state brought about by the passage of time, applicable to systems with internal state (also called ''stateful systems''). In this formulation, ''time'' is not required to be a continuous parameter, but may be discr ...
is preserved at every order of approximation. Similarly, the
unitary Unitary may refer to: Mathematics * Unitary divisor * Unitary element * Unitary group * Unitary matrix * Unitary morphism * Unitary operator * Unitary transformation * Unitary representation * Unitarity (physics) * ''E''-unitary inverse semigr ...
character of the time evolution operator in
quantum mechanics Quantum mechanics is the fundamental physical Scientific theory, theory that describes the behavior of matter and of light; its unusual characteristics typically occur at and below the scale of atoms. Reprinted, Addison-Wesley, 1989, It is ...
is also preserved (in contrast, e.g., to the
Dyson series In scattering theory, a part of mathematical physics, the Dyson series, formulated by Freeman Dyson, is a perturbative expansion of the time evolution operator in the interaction picture. Each term can be represented by a sum of Feynman diagrams. ...
solving the same problem).


Convergence of the expansion

From a mathematical point of view, the convergence problem is the following: given a certain matrix , when can the exponent be obtained as the sum of the Magnus series? A sufficient condition for this series to
converge Converge may refer to: * Converge (band), American hardcore punk band * Converge (Baptist denomination), American national evangelical Baptist body * Limit (mathematics) In mathematics, a limit is the value that a function (or sequence) app ...
for is : \int_0^T \, A(s)\, _2 \, ds < \pi, where \, \cdot \, _2 denotes a
matrix norm In the field of mathematics, norms are defined for elements within a vector space. Specifically, when the vector space comprises matrices, such norms are referred to as matrix norms. Matrix norms differ from vector norms in that they must also ...
. This result is generic in the sense that one may construct specific matrices for which the series diverges for any .


Magnus generator

A recursive procedure to generate all the terms in the Magnus expansion utilizes the matrices defined recursively through : S_n^ = \sum_^ \left Omega_m, S_^\right \quad 2 \leq j \leq n - 1, : S_n^ = \left Omega_, A\right \quad S_n^ = \operatorname_^(A), which then furnish : \Omega_1 = \int_0^t A(\tau) \, d\tau, : \Omega_n = \sum_^ \frac \int_0^t S_n^(\tau) \, d\tau , \quad n \geq 2. Here ad''k''Ω is a shorthand for an iterated commutator (see
adjoint endomorphism In mathematics, the adjoint representation (or adjoint action) of a Lie group ''G'' is a way of representing the elements of the group as linear transformations of the group's Lie algebra, considered as a vector space. For example, if ''G'' is \m ...
): : \operatorname_^0 A = A, \quad \operatorname_^ A = Omega, \operatorname_\Omega^k A while are the
Bernoulli numbers In mathematics, the Bernoulli numbers are a sequence of rational numbers which occur frequently in analysis. The Bernoulli numbers appear in (and can be defined by) the Taylor series expansions of the tangent and hyperbolic tangent functions, ...
with . Finally, when this recursion is worked out explicitly, it is possible to express as a linear combination of ''n''-fold integrals of ''n'' − 1 nested commutators involving matrices : : \Omega_n(t) = \sum_^ \frac \sum_ \int_0^t \operatorname_ \operatorname_ \cdots \operatorname_ A(\tau) \, d\tau, \quad n \ge 2, which becomes increasingly intricate with .


The stochastic case


Extension to stochastic ordinary differential equations

For the extension to the stochastic case let \left(W_t\right)_ be a \mathbb^q-dimensional
Brownian motion Brownian motion is the random motion of particles suspended in a medium (a liquid or a gas). The traditional mathematical formulation of Brownian motion is that of the Wiener process, which is often called Brownian motion, even in mathematical ...
, q\in \mathbb_, on the
probability space In probability theory, a probability space or a probability triple (\Omega, \mathcal, P) is a mathematical construct that provides a formal model of a random process or "experiment". For example, one can define a probability space which models ...
\left(\Omega,\mathcal,\mathbb\right) with finite time horizon T>0 and natural filtration. Now, consider the linear matrix-valued stochastic Itô differential equation (with Einstein's summation convention over the index ) : dX_t = B_t X_t dt + A_t^ X_t dW_t^j,\quad X_0=I_d,\qquad d\in\mathbb_, where B_,A_^,\dots,A_^ are progressively measurable d\times d-valued bounded
stochastic processes In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables in a probability space, where the index of the family often has the interpretation of time. Stoc ...
and I_d is the
identity matrix In linear algebra, the identity matrix of size n is the n\times n square matrix with ones on the main diagonal and zeros elsewhere. It has unique properties, for example when the identity matrix represents a geometric transformation, the obje ...
. Following the same approach as in the deterministic case with alterations due to the stochastic setting the corresponding matrix logarithm will turn out as an Itô-process, whose first two expansion orders are given by Y_t^=Y_t^+Y_t^ and Y_t^=Y_t^+Y_t^+Y_t^, where with Einstein's summation convention over and : \begin Y^_t &= 0,\\ Y^_t &= \int_0^t A^_s \, d W^j_s ,\\ Y^_t &= \int_0^t B_s \, d s,\\ Y^_t &= - \frac \int_0^t \big(A^_s\big)^2 \, d s + \frac \int_0^t \Big A^_s , \int_0^s A^_r \, d W^i_r \Big d W^j_s ,\\ Y^_t &= \frac \int_0^t \Big B_s , \int_0^s A^_r \, d W_r \Big\, ds + \frac \int_0^t \Big A^_s ,\int_0^s B_r \, dr \Big\, dW^j_s,\\ Y^_t &= \frac \int_0^t \Big B_s , \int_0^s B_r \, dr \Big\, ds. \end


Convergence of the expansion

In the stochastic setting the convergence will now be subject to a
stopping time In probability theory, in particular in the study of stochastic processes, a stopping time (also Markov time, Markov moment, optional stopping time or optional time ) is a specific type of "random time": a random variable whose value is interpre ...
\tau and a first convergence result is given by: Under the previous assumption on the coefficients there exists a strong solution X=(X_t)_, as well as a strictly positive stopping time \tau\leq T such that: # X_t has a real logarithm Y_t up to time \tau, i.e.
#: X_t = e^,\qquad 0\leq t<\tau; # the following representation holds \mathbb-almost surely:
#: Y_t = \sum_^ Y^_t,\qquad 0\leq t<\tau,
#:where Y^ is the -th term in the stochastic Magnus expansion as defined below in the subsection Magnus expansion formula; # there exists a positive constant , only dependent on \, A^\, _,\dots,\, A^\, _, \, B\, _, T, d, with \, A_\, _T=\, \, A_t\, _\, _, such that
#: \mathbb (\tau \leq t) \leq C t,\qquad t\in ,T


Magnus expansion formula

The general expansion formula for the stochastic Magnus expansion is given by: : Y_t = \sum_^ Y^_t \quad \text\quad Y^_t := \sum_^ Y^_t, where the general term Y^ is an Itô-process of the form: : Y^_t = \int_0^t \mu^_s d s + \int_0^t \sigma^_s d W^j_s, \qquad n\in \mathbb_0, \ r=0,\dots,n, The terms \sigma^,\mu^ are defined recursively as : \begin \sigma^_s &:= \sum_^\frac S^_s\big(A^\big),\\ \mu^_s &:= \sum_^\frac S^_s(B) - \frac \sum_^q \sum_^\frac \sum_^ \sum_^ S^ \big( Q^ \big), \end with : \begin Q^_s := \sum_^\sum_^ \sum_^ \sum_^ &\sum_^ \sum_^\ \sum_^ \ \sum_^ \\ & \Bigg( \\ & \qquad\qquad + \Bigg), \end and with the operators being defined as : \begin S^_s(A) &:= \begin A & \text r=n=1,\\ 0 & \text, \end\\ S^_s(A) &:= \sum_ \big ^_s , \big[ \dots , \big[ Y^_s, A_s \big\dots \big">\dots_,_\big[__Y^_s,_A_s___\big.html" ;"title="^_s , \big[ \dots , \big[ Y^_s, A_s \big">^_s , \big[ \dots , \big[ Y^_s, A_s \big\dots \big \big] \\ &= \sum_ \operatorname_ \circ \cdots \circ \operatorname_(A_s) , \qquad i\in\mathbb. \end


Applications

Since the 1960s, the Magnus expansion has been successfully applied as a perturbative tool in numerous areas of physics and chemistry, from atomic and
molecular physics Molecular physics is the study of the physical properties of molecules and molecular dynamics. The field overlaps significantly with physical chemistry, chemical physics, and quantum chemistry. It is often considered as a sub-field of atomic, mo ...
to
nuclear magnetic resonance Nuclear magnetic resonance (NMR) is a physical phenomenon in which nuclei in a strong constant magnetic field are disturbed by a weak oscillating magnetic field (in the near field) and respond by producing an electromagnetic signal with a ...
and
quantum electrodynamics In particle physics, quantum electrodynamics (QED) is the Theory of relativity, relativistic quantum field theory of electrodynamics. In essence, it describes how light and matter interact and is the first theory where full agreement between quant ...
. (See Rabi model.) It has been also used since 1998 as a tool to construct practical algorithms for the numerical integration of matrix linear differential equations. As they inherit from the Magnus expansion the preservation of qualitative traits of the problem, the corresponding schemes are prototypical examples of geometric numerical integrators.


See also

* Baker–Campbell–Hausdorff formula *
Derivative of the exponential map In the theory of Lie groups, the exponential map is a map from the Lie algebra of a Lie group into . In case is a matrix Lie group, the exponential map reduces to the matrix exponential. The exponential map, denoted , is analytic and has as s ...


Notes


References

* * * * *


External links

*
UCSD The University of California, San Diego (UC San Diego in communications material, formerly and colloquially UCSD) is a public land-grant research university in San Diego, California, United States. Established in 1960 near the pre-existing ...
* * {{cite web, url=https://www.youtube.com/watch?v=PujxIFxk3qs , title=Motivation for Magnus and Fer expansions , date=December 25, 2020 , website=YouTube Ordinary differential equations Stochastic differential equations Lie algebras Mathematical physics