Hadamard's Inequality
   HOME

TheInfoList



OR:

In
mathematics Mathematics is a field of study that discovers and organizes methods, Mathematical theory, theories and theorems that are developed and Mathematical proof, proved for the needs of empirical sciences and mathematics itself. There are many ar ...
, Hadamard's inequality (also known as Hadamard's theorem on determinants) is a result first published by
Jacques Hadamard Jacques Salomon Hadamard (; 8 December 1865 – 17 October 1963) was a French mathematician who made major contributions in number theory, complex analysis, differential geometry, and partial differential equations. Biography The son of a tea ...
in 1893.Maz'ya & Shaposhnikova It is a bound on the
determinant In mathematics, the determinant is a Scalar (mathematics), scalar-valued function (mathematics), function of the entries of a square matrix. The determinant of a matrix is commonly denoted , , or . Its value characterizes some properties of the ...
of a
matrix Matrix (: matrices or matrixes) or MATRIX may refer to: Science and mathematics * Matrix (mathematics), a rectangular array of numbers, symbols or expressions * Matrix (logic), part of a formula in prenex normal form * Matrix (biology), the m ...
whose entries are
complex number In mathematics, a complex number is an element of a number system that extends the real numbers with a specific element denoted , called the imaginary unit and satisfying the equation i^= -1; every complex number can be expressed in the for ...
s in terms of the lengths of its column vectors. In
geometrical Geometry (; ) is a branch of mathematics concerned with properties of space such as the distance, shape, size, and relative position of figures. Geometry is, along with arithmetic, one of the oldest branches of mathematics. A mathematician w ...
terms, when restricted to
real number In mathematics, a real number is a number that can be used to measure a continuous one- dimensional quantity such as a duration or temperature. Here, ''continuous'' means that pairs of values can have arbitrarily small differences. Every re ...
s, it bounds the
volume Volume is a measure of regions in three-dimensional space. It is often quantified numerically using SI derived units (such as the cubic metre and litre) or by various imperial or US customary units (such as the gallon, quart, cubic inch) ...
in
Euclidean space Euclidean space is the fundamental space of geometry, intended to represent physical space. Originally, in Euclid's ''Elements'', it was the three-dimensional space of Euclidean geometry, but in modern mathematics there are ''Euclidean spaces ...
of ''n'' dimensions marked out by ''n'' vectors ''vi'' for 1 ≤ ''i'' ≤ ''n'' in terms of the lengths of these vectors , , ''vi'', , . Specifically, Hadamard's inequality states that if ''N'' is the matrix having columns ''vi'', then :\left, \det(N) \ \le \prod_^n \, v_i\, . If the ''n'' vectors are non-zero, equality in Hadamard's inequality is achieved
if and only if In logic and related fields such as mathematics and philosophy, "if and only if" (often shortened as "iff") is paraphrased by the biconditional, a logical connective between statements. The biconditional is true in two cases, where either bo ...
the vectors are
orthogonal In mathematics, orthogonality (mathematics), orthogonality is the generalization of the geometric notion of ''perpendicularity''. Although many authors use the two terms ''perpendicular'' and ''orthogonal'' interchangeably, the term ''perpendic ...
.


Alternate forms and corollaries

A
corollary In mathematics and logic, a corollary ( , ) is a theorem of less importance which can be readily deduced from a previous, more notable statement. A corollary could, for instance, be a proposition which is incidentally proved while proving another ...
is that if the entries of an ''n'' by ''n'' matrix ''N'' are bounded by ''B'', so , ''Nij'', ≤ ''B'' for all ''i'' and ''j'', then :\left, \det(N) \ \le B^n n^. In particular, if the entries of ''N'' are +1 and −1 only then :\left, \det(N) \ \le n^. In
combinatorics Combinatorics is an area of mathematics primarily concerned with counting, both as a means and as an end to obtaining results, and certain properties of finite structures. It is closely related to many other areas of mathematics and has many ...
, matrices ''N'' for which equality holds, i.e. those with orthogonal columns, are called Hadamard matrices. More generally, suppose that ''N'' is a
complex Complex commonly refers to: * Complexity, the behaviour of a system whose components interact in multiple ways so possible interactions are difficult to describe ** Complex system, a system composed of many components which may interact with each ...
matrix of order ''n'', whose entries are bounded by , ''Nij'', ≤ 1, for each ''i'', ''j'' between 1 and ''n''. Then Hadamard's inequality states that : , \operatorname(N), \leq n^. Equality in this bound is attained for a real matrix ''N''
if and only if In logic and related fields such as mathematics and philosophy, "if and only if" (often shortened as "iff") is paraphrased by the biconditional, a logical connective between statements. The biconditional is true in two cases, where either bo ...
''N'' is a Hadamard matrix. A
positive-semidefinite matrix In mathematics, a symmetric matrix M with real entries is positive-definite if the real number \mathbf^\mathsf M \mathbf is positive for every nonzero real column vector \mathbf, where \mathbf^\mathsf is the row vector transpose of \mathbf. Mo ...
''P'' can be written as ''N''*''N'', where ''N''* denotes the
conjugate transpose In mathematics, the conjugate transpose, also known as the Hermitian transpose, of an m \times n complex matrix \mathbf is an n \times m matrix obtained by transposing \mathbf and applying complex conjugation to each entry (the complex conjugate ...
of ''N'' (see Decomposition of a semidefinite matrix). Then :\det(P)=\det(N)^2 \le \prod_^n \, v_i\, ^2 = \prod_^n p_. So, the determinant of a
positive definite matrix In mathematics, a symmetric matrix M with real entries is positive-definite if the real number \mathbf^\mathsf M \mathbf is positive for every nonzero real column vector \mathbf, where \mathbf^\mathsf is the row vector transpose of \mathbf. Mo ...
is less than or equal to the product of its diagonal entries. Sometimes this is also known as Hadamard's inequality.


Proof

The result is trivial if the matrix ''N'' is
singular Singular may refer to: * Singular, the grammatical number that denotes a unit quantity, as opposed to the plural and other forms * Singular or sounder, a group of boar, see List of animal names * Singular (band), a Thai jazz pop duo *'' Singula ...
, so assume the columns of ''N'' are
linearly independent In the theory of vector spaces, a set of vectors is said to be if there exists no nontrivial linear combination of the vectors that equals the zero vector. If such a linear combination exists, then the vectors are said to be . These concep ...
. By dividing each column by its Euclidean norm, it can be seen that the result is equivalent to the special case where each column has norm 1, in other words if ''ei'' are
unit vector In mathematics, a unit vector in a normed vector space is a Vector (mathematics and physics), vector (often a vector (geometry), spatial vector) of Norm (mathematics), length 1. A unit vector is often denoted by a lowercase letter with a circumfle ...
s and ''M'' is the matrix having the ''ei'' as columns then and equality is achieved if and only if the vectors are an orthogonal set. The general result now follows: :\left, \det N \ = \bigg (\prod_^n \, v_i\, \bigg) \left, \det M\ \leq \prod_^n \, v_i\, . To prove (1), consider ''P'' =''M*M'' where ''M*'' is the conjugate transpose of ''M'', and let the
eigenvalue In linear algebra, an eigenvector ( ) or characteristic vector is a vector that has its direction unchanged (or reversed) by a given linear transformation. More precisely, an eigenvector \mathbf v of a linear transformation T is scaled by a ...
s of ''P'' be λ1, λ2, … λ''n''. Since the length of each column of ''M'' is 1, each entry in the diagonal of ''P'' is 1, so the
trace Trace may refer to: Arts and entertainment Music * ''Trace'' (Son Volt album), 1995 * ''Trace'' (Died Pretty album), 1993 * Trace (band), a Dutch progressive rock band * ''The Trace'' (album), by Nell Other uses in arts and entertainment * ...
of ''P'' is ''n''. Applying the
inequality of arithmetic and geometric means Inequality may refer to: * Inequality (mathematics), a relation between two quantities when they are different. * Economic inequality, difference in economic well-being between population groups ** Income inequality, an unequal distribution of in ...
, :\det P = \prod_^n \lambda_i \le \bigg(\sum_^n \lambda_i\bigg)^n = \left( \operatorname P \right)^n = 1^n = 1, so : \left, \det M \ = \sqrt \le 1. If there is equality then each of the ''λ''''i'''s must all be equal and their sum is ''n'', so they must all be 1. The matrix ''P'' is
Hermitian {{Short description, none Numerous things are named after the French mathematician Charles Hermite (1822–1901): Hermite * Cubic Hermite spline, a type of third-degree spline * Gauss–Hermite quadrature, an extension of Gaussian quadrature me ...
, therefore
diagonalizable In linear algebra, a square matrix A is called diagonalizable or non-defective if it is similar to a diagonal matrix. That is, if there exists an invertible matrix P and a diagonal matrix D such that . This is equivalent to (Such D are not ...
, so it is the
identity matrix In linear algebra, the identity matrix of size n is the n\times n square matrix with ones on the main diagonal and zeros elsewhere. It has unique properties, for example when the identity matrix represents a geometric transformation, the obje ...
—in other words the columns of ''M'' are an orthonormal set and the columns of ''N'' are an orthogonal set.Proof follows, with minor modifications, the second proof given in Maz'ya & Shaposhnikova. Many other proofs can be found in the literature.


See also

* Fischer's inequality


Notes


References

* * * *


Further reading

* {{DEFAULTSORT:Hadamard's Inequality Inequalities (mathematics) Determinants