Algebraic Riccati Equation

An algebraic Riccati equation is a type of nonlinear equation that arises in the context of infinite-horizon optimal control problems in continuous time or discrete time.

A typical algebraic Riccati equation is similar to one of the following:

the continuous time algebraic Riccati equation (CARE):

$A^\top P + P A - P B R^ B^\top P + Q = 0$

or the discrete time algebraic Riccati equation (DARE):

$P = A^\top P A -(A^\top P B)(R + B^\top P B)^(B^\top P A) + Q.$

is the unknown by symmetric matrix and are known real coefficient matrices, with and symmetric.

Though generally this equation can have many solutions, it is usually specified that we want to obtain the unique stabilizing solution, if such a solution exists.

Origin of the name

The name Riccati is given to these equations because of their relation to the Riccati differential equation. Indeed, the CARE is verified by the time invariant solutions of the associated matrix valued Riccati differential equation. As for the discrete-time algebraic Riccati equation, or DARE, it is verified by the time invariant solutions of the matrix valued Riccati difference equation (which is the analogue of the Riccati differential equation in the context of discrete time LQR).

Context of the discrete-time algebraic Riccati equation

In infinite-horizon optimal control problems, one cares about the value of some variable of interest arbitrarily far into the future, and one must optimally choose a value of a controlled variable right now, knowing that one will also behave optimally at all times in the future. The optimal current values of the problem's control variables at any time can be found using the solution of the Riccati equation and the current observations on evolving state variables. With multiple state variables and multiple control variables, the Riccati equation will be a matrix equation.

The algebraic Riccati equation determines the solution of the infinite-horizon time-invariant Linear-Quadratic Regulator problem (LQR) as well as that of the infinite horizon time-invariant Linear-Quadratic-Gaussian control problem (LQG). These are two of the most fundamental problems in control theory.

A typical specification of the discrete-time linear quadratic control problem is to minimize

$\sum_^T (x_t^\top Q x_t + u_t^\top Ru_t)$

subject to the state equation

$x_t = Ax_ + Bu_,$

where is an vector of state variables, is a vector of control variables, is the state transition matrix, is the matrix of control multipliers, () is a symmetric positive semi-definite state cost matrix, and () is a symmetric positive definite control cost matrix.

Induction backwards in time can be used to obtain the optimal control solution at each time,

$u_t^* = -(B^\top P_B+R)^ (B^\top P_A)x_,$

with the symmetric positive definite cost-to-go matrix evolving backwards in time from according to

$P_ = Q+A^\top P_tA - A^\top P_tB(B^\top P_tB+R)^B^\top P_tA, \,$

which is known as the discrete-time dynamic Riccati equation of this problem. The steady-state characterization of , relevant for the infinite-horizon problem in which goes to infinity, can be found by iterating the dynamic equation repeatedly until it converges; then is characterized by removing the time subscripts from the dynamic equation.

Solution

Usually solvers try to find the unique stabilizing solution, if such a solution exists. A solution is stabilizing if using it for controlling the associated LQR system makes the closed loop system stable.

For the CARE, the control is
$K = R^ B^\top P$
and the closed loop state transfer matrix is
$A - BK = A - B R^ B^\top P$
which is stable if and only if all of its eigenvalues have strictly negative real part.

For the DARE, the control is
$K = (R + B^\top P B)^ B^\top P A$
and the closed loop state transfer matrix is
$A - BK = A - B (R + B^\top P B)^ B^\top P A$
which is stable if and only if all of its eigenvalues are strictly inside the unit circle of the complex plane.

A solution to the algebraic Riccati equation can be obtained by matrix factorizations or by iterating on the Riccati equation. One type of iteration can be obtained in the discrete time case by using the ''dynamic'' Riccati equation that arises in the finite-horizon problem: in the latter type of problem each iteration of the value of the matrix is relevant for optimal choice at each period that is a finite distance in time from a final time period, and if it is iterated infinitely far back in time it converges to the specific matrix that is relevant for optimal choice an infinite length of time prior to a final period—that is, for when there is an infinite horizon.

It is also possible to find the solution by finding the eigendecomposition of a larger system. For the CARE, we define the Hamiltonian matrix
$Z = \begin A & -B R^ B^\top \\ -Q & -A^\top \end$
Since is Hamiltonian, if it does not have any eigenvalues on the imaginary axis, then exactly half of its eigenvalues have a negative real part. If we denote the matrix whose columns form a basis of the corresponding subspace, in block-matrix notation, as
$\begin U_ \\ U_ \end$
then
$P = U_ U_^$
is a solution of the Riccati equation; furthermore, the eigenvalues of $A - B R^ B^\top P$ are the eigenvalues of with negative real part.

For the DARE, when is invertible, we define the symplectic matrix
$Z = \begin A + B R^ B^\top (A^)^\top Q & -B R^ B^\top (A^)^\top \\ -(A^)^\top Q & (A^)^\top \end$
Since is symplectic, if it does not have any eigenvalues on the unit circle, then exactly half of its eigenvalues are inside the unit circle. If we denote the matrix whose columns form a basis of the corresponding subspace, in block-matrix notation, as
$\begin U_ \\ U_ \end$
where result from the decomposition
$Z = \begin U_ & U_ \\ U_ & U_ \end \begin \Lambda_ & \Lambda_ \\ 0 & \Lambda_ \end \begin U_^\top & U_^\top \\ U_^\top & U_^\top \end$
then
$P = U_ U_^$
is a solution of the Riccati equation; furthermore, the eigenvalues of $A - B (R + B^\top P B)^ B^\top P A$ are the eigenvalues of that are inside the unit circle.

See also

* Lyapunov equation
*Schur decomposition
* Sylvester equation

References

*
*.

External links

CARE solver help of MATLAB Control toolbox.



Online CARE solver for arbitrary sized matrices.




* ttps://reference.wolfram.com/mathematica/ref/DiscreteRiccatiSolve.html Mathematica function to solve the discrete-time algebraic Riccati equation.
{{DEFAULTSORT:Algebraic Riccati Equation
Matrices (mathematics)
Equations
Optimal control