In
numerical analysis, the minimum degree algorithm is an
algorithm used to permute the rows and columns of a
symmetric sparse matrix before applying the
Cholesky decomposition, to reduce the number of non-zeros in the Cholesky factor.
This results in reduced storage requirements and means that the Cholesky factor can be applied with fewer arithmetic operations. (Sometimes it may also pertain to an incomplete Cholesky factor used as a preconditioner—for example, in the preconditioned conjugate gradient algorithm.)
Minimum degree algorithms are often used in the
finite element method where the reordering of nodes can be carried out depending only on the topology of the mesh, rather than on the coefficients in the partial differential equation, resulting in efficiency savings when the same mesh is used for a variety of coefficient values.
Given a linear system
:
where A is an
real symmetric sparse square matrix. The Cholesky factor L will typically suffer 'fill in', that is have more non-zeros than the upper triangle of A. We seek a
permutation matrix
In mathematics, particularly in matrix theory, a permutation matrix is a square binary matrix that has exactly one entry of 1 in each row and each column and 0s elsewhere. Each such matrix, say , represents a permutation of elements and, when ...
P, so that the matrix
, which is also symmetric, has the least possible fill in its Cholesky factor. We solve the reordered system
:
The problem of finding the best ordering is an
NP-complete problem and is thus intractable, so heuristic methods are used instead. The minimum degree algorithm is derived from a method first proposed by
Markowitz Markowitz may refer to:
People
* Deborah Markowitz, Vermont secretary of state
* Gerald Markowitz, American historian
* Harry Markowitz, a financial economist and Nobel Laureate
* John Markowitz, professor of psychiatry at Weill Cornell Medical Co ...
in 1959 for non-symmetric
linear programming
Linear programming (LP), also called linear optimization, is a method to achieve the best outcome (such as maximum profit or lowest cost) in a mathematical model whose requirements are represented by linear function#As a polynomial function, li ...
problems, which is loosely described as follows. At each step in
Gaussian elimination
In mathematics, Gaussian elimination, also known as row reduction, is an algorithm for solving systems of linear equations. It consists of a sequence of operations performed on the corresponding matrix of coefficients. This method can also be used ...
row and column permutations are performed so as to minimize the number of off diagonal non-zeros in the pivot row and column. A symmetric version
of Markowitz method was described by Tinney and Walker in 1967 and Rose later derived a graph theoretic version of the algorithm where the factorization is only simulated, and this was named the minimum degree algorithm. The graph referred to is the graph with ''n'' vertices, with vertices ''i'' and ''j'' connected by an edge when
, and the ''degree'' is the degree of the vertices. A crucial aspect of such algorithms is a tie breaking strategy when there is a choice of renumbering resulting in the same degree.
A version of the minimum degree algorithm was implemented in the
MATLAB function symmmd (where MMD stands for multiple minimum degree), but has now been superseded by a symmetric approximate multiple minimum degree function symamd, which is faster. This is confirmed by theoretical analysis, which shows that for graphs with ''n'' vertices and ''m'' edges, MMD has a tight
upper bound of
on its running time, whereas for AMD a tight bound of
holds. Cummings, Fahrbach, and Fatehpuria designed an exact minimum degree algorithm with
running time, and showed that no such algorithm can exist that runs in time
, for any
, assuming the
strong exponential time hypothesis
In computational complexity theory, the exponential time hypothesis is an unproven computational hardness assumption that was formulated by . It states that satisfiability of 3-CNF Boolean formulas cannot be solved more quickly than exponential t ...
.
References
*
*
*
*
*
*
{{DEFAULTSORT:Minimum Degree Algorithm
Numerical linear algebra
Matrix theory