Frobenius normal form
   HOME

TheInfoList



OR:

In
linear algebra Linear algebra is the branch of mathematics concerning linear equations such as: :a_1x_1+\cdots +a_nx_n=b, linear maps such as: :(x_1, \ldots, x_n) \mapsto a_1x_1+\cdots +a_nx_n, and their representations in vector spaces and through matrices ...
, the Frobenius normal form or rational canonical form of a square matrix ''A'' with entries in a
field Field may refer to: Expanses of open ground * Field (agriculture), an area of land used for agricultural purposes * Airfield, an aerodrome that lacks the infrastructure of an airport * Battlefield * Lawn, an area of mowed grass * Meadow, a grass ...
''F'' is a
canonical form In mathematics and computer science, a canonical, normal, or standard form of a mathematical object is a standard way of presenting that object as a mathematical expression. Often, it is one which provides the simplest representation of an ...
for
matrices Matrix most commonly refers to: * ''The Matrix'' (franchise), an American media franchise ** ''The Matrix'', a 1999 science-fiction action film ** "The Matrix", a fictional setting, a virtual reality environment, within ''The Matrix'' (franchis ...
obtained by conjugation by invertible matrices over ''F''. The form reflects a minimal decomposition of the vector space into subspaces that are cyclic for ''A'' (i.e., spanned by some vector and its repeated images under ''A''). Since only one normal form can be reached from a given matrix (whence the "canonical"), a matrix ''B'' is similar to ''A'' if and only if it has the same rational canonical form as ''A''. Since this form can be found without any operations that might change when extending the field ''F'' (whence the "rational"), notably without factoring polynomials, this shows that whether two matrices are similar does not change upon field extensions. The form is named after German mathematician Ferdinand Georg Frobenius. Some authors use the term rational canonical form for a somewhat different form that is more properly called the primary rational canonical form. Instead of decomposing into a minimal number of cyclic subspaces, the primary form decomposes into a maximal number of cyclic subspaces. It is also defined over ''F'', but has somewhat different properties: finding the form requires
factorization of polynomials In mathematics and computer algebra, factorization of polynomials or polynomial factorization expresses a polynomial with coefficients in a given field or in the integers as the product of irreducible factors with coefficients in the same do ...
, and as a consequence the primary rational canonical form may change when the same matrix is considered over an extension field of ''F''. This article mainly deals with the form that does not require factorization, and explicitly mentions "primary" when the form using factorization is meant.


Motivation

When trying to find out whether two square matrices ''A'' and ''B'' are similar, one approach is to try, for each of them, to decompose the vector space as far as possible into a direct sum of stable subspaces, and compare the respective actions on these subspaces. For instance if both are diagonalizable, then one can take the decomposition into eigenspaces (for which the action is as simple as it can get, namely by a scalar), and then similarity can be decided by comparing eigenvalues and their multiplicities. While in practice this is often a quite insightful approach, there are various drawbacks this has as a general method. First, it requires finding all eigenvalues, say as roots of the characteristic polynomial, but it may not be possible to give an explicit expression for them. Second, a complete set of eigenvalues might exist only in an extension of the field one is working over, and then one does not get a proof of similarity over the original field. Finally ''A'' and ''B'' might not be diagonalizable even over this larger field, in which case one must instead use a decomposition into generalized eigenspaces, and possibly into Jordan blocks. But obtaining such a fine decomposition is not necessary to just decide whether two matrices are similar. The rational canonical form is based on instead using a direct sum decomposition into stable subspaces that are as large as possible, while still allowing a very simple description of the action on each of them. These subspaces must be generated by a single nonzero vector ''v'' and all its images by repeated application of the linear operator associated to the matrix; such subspaces are called cyclic subspaces (by analogy with cyclic subgroups) and they are clearly stable under the linear operator. A basis of such a subspace is obtained by taking ''v'' and its successive images as long as they are linearly independent. The matrix of the linear operator with respect to such a basis is the
companion matrix In linear algebra, the Frobenius companion matrix of the monic polynomial : p(t)=c_0 + c_1 t + \cdots + c_t^ + t^n ~, is the square matrix defined as :C(p)=\begin 0 & 0 & \dots & 0 & -c_0 \\ 1 & 0 & \dots & 0 & -c_1 \\ 0 & 1 & \dots & 0 & -c_2 ...
of a monic polynomial; this polynomial (the minimal polynomial of the operator restricted to the subspace, which notion is analogous to that of the order of a cyclic subgroup) determines the action of the operator on the cyclic subspace up to isomorphism, and is independent of the choice of the vector ''v'' generating the subspace. A direct sum decomposition into cyclic subspaces always exists, and finding one does not require factoring polynomials. However it is possible that cyclic subspaces do allow a decomposition as direct sum of smaller cyclic subspaces (essentially by the Chinese remainder theorem). Therefore, just having for both matrices some decomposition of the space into cyclic subspaces, and knowing the corresponding minimal polynomials, is not in itself sufficient to decide their similarity. An additional condition is imposed to ensure that for similar matrices one gets decompositions into cyclic subspaces that exactly match: in the list of associated minimal polynomials each one must divide the next (and the constant polynomial 1 is forbidden to exclude trivial cyclic subspaces of dimension 0). The resulting list of polynomials are called the
invariant factors The invariant factors of a module over a principal ideal domain (PID) occur in one form of the structure theorem for finitely generated modules over a principal ideal domain. If R is a PID and M a finitely generated R-module, then :M\cong R^r ...
of (the ''K'' 'X''module defined by) the matrix, and two matrices are similar if and only if they have identical lists of invariant factors. The rational canonical form of a matrix ''A'' is obtained by expressing it on a basis adapted to a decomposition into cyclic subspaces whose associated minimal polynomials are the invariant factors of ''A''; two matrices are similar if and only if they have the same rational canonical form.


Example

Consider the following matrix A, over Q: :\scriptstyle A=\begin -1& 3&-1& 0&-2& 0& 0&-2 \\ -1&-1& 1& 1&-2&-1& 0&-1 \\ -2&-6& 4& 3&-8&-4&-2& 1 \\ -1& 8&-3&-1& 5& 2& 3&-3 \\ 0& 0& 0& 0& 0& 0& 0& 1 \\ 0& 0& 0& 0&-1& 0& 0& 0 \\ 1& 0& 0& 0& 2& 0& 0& 0 \\ 0& 0& 0& 0& 4& 0& 1& 0 \end. ''A'' has minimal polynomial \mu=X^6-4X^4-2X^3+4X^2+4X+1, so that the dimension of a subspace generated by the repeated images of a single vector is at most 6. The characteristic polynomial is \chi=X^8-X^7-5X^6+2X^5+10X^4+2X^3-7X^2-5X-1, which is a multiple of the minimal polynomial by a factor X^2-X-1. There always exist vectors such that the cyclic subspace that they generate has the same minimal polynomial as the operator has on the whole space; indeed most vectors will have this property, and in this case the first standard basis vector e_1 does so: the vectors A^k(e_1) for k=0,1,\ldots,5 are linearly independent and span a cyclic subspace with minimal polynomial \mu. There exist complementary stable subspaces (of dimension 2) to this cyclic subspace, and the space generated by vectors v=(3,4,8,0,-1,0,2,-1)^\top and w=(5,4,5,9,-1,1,1,-2)^\top is an example. In fact one has A\cdot v=w, so the complementary subspace is a cyclic subspace generated by v; it has minimal polynomial X^2-X-1. Since \mu is the minimal polynomial of the whole space, it is clear that X^2-X-1 must divide \mu (and it is easily checked that it does), and we have found the invariant factors X^2-X-1 and \mu=X^6-4X^4-2X^3+4X^2+4X+1 of ''A''. Then the rational canonical form of ''A'' is the block diagonal matrix with the corresponding companion matrices as diagonal blocks, namely :\scriptstyle C=\begin 0& 1& 0& 0& 0& 0& 0& 0 \\ 1& 1& 0& 0& 0& 0& 0& 0 \\ 0& 0& 0& 0& 0& 0& 0&-1 \\ 0& 0& 1& 0& 0& 0& 0&-4 \\ 0& 0& 0& 1& 0& 0& 0&-4 \\ 0& 0& 0& 0& 1& 0& 0& 2 \\ 0& 0& 0& 0& 0& 1& 0& 4 \\ 0& 0& 0& 0& 0& 0& 1& 0 \end. A basis on which this form is attained is formed by the vectors v,w above, followed by A^k(e_1) for k=0,1,\ldots,5; explicitly this means that for :\scriptstyle P=\begin 3& 5& 1&-1& 0& 0& -4& 0\\ 4& 4& 0&-1&-1&-2& -3&-5\\ 8& 5& 0&-2&-5&-2&-11&-6\\ 0& 9& 0&-1& 3&-2& 0& 0\\ -1&-1& 0& 0& 0& 1& -1& 4\\ 0& 1& 0& 0& 0& 0& -1& 1\\ 2& 1& 0& 1&-1& 0& 2&-6\\ -1&-2& 0& 0& 1&-1& 4&-2 \end, one has A=PCP^.


General case and theory

Fix a base field ''F'' and a finite- dimensional
vector space In mathematics and physics, a vector space (also called a linear space) is a set whose elements, often called '' vectors'', may be added together and multiplied ("scaled") by numbers called ''scalars''. Scalars are often real numbers, but can ...
''V'' over ''F''. Given a polynomial ''P'' ∈ ''F'' 'X'' there is associated to it a
companion matrix In linear algebra, the Frobenius companion matrix of the monic polynomial : p(t)=c_0 + c_1 t + \cdots + c_t^ + t^n ~, is the square matrix defined as :C(p)=\begin 0 & 0 & \dots & 0 & -c_0 \\ 1 & 0 & \dots & 0 & -c_1 \\ 0 & 1 & \dots & 0 & -c_2 ...
''C''''P'' whose characteristic polynomial and ''minimal polynomial'' are both equal to ''P''. Theorem: Let ''V'' be a finite-dimensional vector space over a field ''F'', and ''A'' a square matrix over ''F''. Then ''V'' (viewed as an ''F'' 'X''
module Module, modular and modularity may refer to the concept of modularity. They may also refer to: Computing and engineering * Modular design, the engineering discipline of designing complex devices using separately designed sub-components * Mo ...
with the action of ''X'' given by ''A'') admits a ''F'' 'X''module isomorphism :''V'' ≅ ''F'' 'X''''f''1 ⊕ … ⊕ ''F'' 'X''''f''''k'' where the ''f''''i'' ∈ ''F'' 'X''may be taken to be
monic polynomial In algebra, a monic polynomial is a single-variable polynomial (that is, a univariate polynomial) in which the leading coefficient (the nonzero coefficient of highest degree) is equal to 1. Therefore, a monic polynomial has the form: :x^n+c_x^+\c ...
s of positive degree (so they are non-
unit Unit may refer to: Arts and entertainment * UNIT, a fictional military organization in the science fiction television series ''Doctor Who'' * Unit of action, a discrete piece of action (or beat) in a theatrical presentation Music * ''Unit'' (a ...
s in ''F'' 'X'' that satisfy the relations :''f''1 , ''f''2 , … , ''f''''k'' where "a , b" is notation for "''a'' divides ''b''"; with these conditions the list of polynomials ''f''''i'' is unique. ''Sketch of Proof'': Apply the structure theorem for finitely generated modules over a principal ideal domain to ''V'', viewing it as an ''F'' 'X''module. The structure theorem provides a decomposition into cyclic factors, each of which is a quotient of ''F'' 'X''by a proper ideal; the zero ideal cannot be present since the resulting free module would be infinite-dimensional as ''F'' vector space, while ''V'' is finite-dimensional. For the polynomials ''f''''i'' one then takes the unique monic generators of the respective ideals, and since the structure theorem ensures containment of every ideal in the preceding ideal, one obtains the divisibility conditions for the ''f''''i''. See Ffor details. Given an arbitrary square matrix, the
elementary divisors In algebra, the elementary divisors of a module over a principal ideal domain (PID) occur in one form of the structure theorem for finitely generated modules over a principal ideal domain. If R is a PID and M a finitely generated R-module, then '' ...
used in the construction of the
Jordan normal form In linear algebra, a Jordan normal form, also known as a Jordan canonical form (JCF), is an upper triangular matrix of a particular form called a Jordan matrix representing a linear operator on a finite-dimensional vector space with respect to so ...
do not exist over ''F'' 'X'' so the
invariant factors The invariant factors of a module over a principal ideal domain (PID) occur in one form of the structure theorem for finitely generated modules over a principal ideal domain. If R is a PID and M a finitely generated R-module, then :M\cong R^r ...
''f''''i'' as given above must be used instead. The last of these factors ''f''''k'' is then minimal polynomial, which all the invariant factors therefore divide, and the product of the invariant factors gives the characteristic polynomial. Note that this implies that the minimal polynomial divides the characteristic polynomial (which is essentially the Cayley-Hamilton theorem), and that every irreducible factor of the characteristic polynomial also divides the minimal polynomial (possibly with lower multiplicity). For each invariant factor ''f''''i'' one takes its
companion matrix In linear algebra, the Frobenius companion matrix of the monic polynomial : p(t)=c_0 + c_1 t + \cdots + c_t^ + t^n ~, is the square matrix defined as :C(p)=\begin 0 & 0 & \dots & 0 & -c_0 \\ 1 & 0 & \dots & 0 & -c_1 \\ 0 & 1 & \dots & 0 & -c_2 ...
''C''''f''''i'', and the block diagonal matrix formed from these blocks yields the rational canonical form of ''A''. When the minimal polynomial is identical to the characteristic polynomial (the case ''k'' = 1), the Frobenius normal form is the companion matrix of the characteristic polynomial. As the rational canonical form is uniquely determined by the unique invariant factors associated to ''A'', and these invariant factors are independent of
basis Basis may refer to: Finance and accounting * Adjusted basis, the net cost of an asset after adjusting for various tax-related items *Basis point, 0.01%, often used in the context of interest rates * Basis trading, a trading strategy consisting ...
, it follows that two square matrices ''A'' and ''B'' are similar if and only if they have the same rational canonical form.


A rational normal form generalizing the Jordan normal form

The Frobenius normal form does not reflect any form of factorization of the characteristic polynomial, even if it does exist over the ground field ''F''. This implies that it is invariant when ''F'' is replaced by a different field (as long as it contains the entries of the original matrix ''A''). On the other hand, this makes the Frobenius normal form rather different from other normal forms that do depend on factoring the characteristic polynomial, notably the
diagonal form In mathematics, a diagonal form is an algebraic form (homogeneous polynomial) without cross-terms involving different indeterminates. That is, it is :\sum_^n a_i ^m\ for some given degree ''m''. Such forms ''F'', and the hypersurfaces ''F'' = ...
(if ''A'' is diagonalizable) or more generally the
Jordan normal form In linear algebra, a Jordan normal form, also known as a Jordan canonical form (JCF), is an upper triangular matrix of a particular form called a Jordan matrix representing a linear operator on a finite-dimensional vector space with respect to so ...
(if the characteristic polynomial splits into linear factors). For instance, the Frobenius normal form of a diagonal matrix with distinct diagonal entries is just the companion matrix of its characteristic polynomial. There is another way to define a normal form, that, like the Frobenius normal form, is always defined over the same field ''F'' as ''A'', but that does reflect a possible factorization of the characteristic polynomial (or equivalently the minimal polynomial) into irreducible factors over ''F'', and which reduces to the Jordan normal form when this factorization only contains linear factors (corresponding to
eigenvalue In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denoted ...
s). This form is sometimes called the generalized Jordan normal form, or primary rational canonical form. It is based on the fact that the vector space can be canonically decomposed into a direct sum of stable subspaces corresponding to the ''distinct'' irreducible factors ''P'' of the characteristic polynomial (as stated by the Xavier Gourdon, ''Les maths en tête, Mathématiques pour M', Algèbre'', 1998, Ellipses, Th. 1 p. 173), where the characteristic polynomial of each summand is a power of the corresponding ''P''. These summands can be further decomposed, non-canonically, as a direct sum of cyclic ''F'' 'x''modules (like is done for the Frobenius normal form above), where the characteristic polynomial of each summand is still a (generally smaller) power of ''P''. The primary rational canonical form is a
block diagonal matrix In mathematics, a block matrix or a partitioned matrix is a matrix that is '' interpreted'' as having been broken into sections called blocks or submatrices. Intuitively, a matrix interpreted as a block matrix can be visualized as the original m ...
corresponding to such a decomposition into cyclic modules, with a particular form called ''generalized Jordan block'' in the diagonal blocks, corresponding to a particular choice of a basis for the cyclic modules. This generalized Jordan block is itself a block matrix of the form :\scriptstyle\beginC&0&\cdots&0\\U&C&\cdots&0\\\vdots&\ddots&\ddots&\vdots\\0&\cdots&U&C\end where ''C'' is the companion matrix of the irreducible polynomial , and is a matrix whose sole nonzero entry is a 1 in the upper right hand corner. For the case of a linear irreducible factor , these blocks are reduced to single entries and and, one finds a (transposed)
Jordan block In the mathematical discipline of matrix theory, a Jordan matrix, named after Camille Jordan, is a block diagonal matrix over a ring (whose identities are the zero 0 and one 1), where each block along the diagonal, called a Jordan block, has t ...
. In any generalized Jordan block, all entries immediately below the main diagonal are 1. A basis of the cyclic module giving rise to this form is obtained by choosing a generating vector (one that is not annihilated by where the minimal polynomial of the cyclic module is ), and taking as basis : v,A(v),A^2(v),\ldots,A^(v), ~ P(A)(v), A(P(A)(v)),\ldots,A^(P(A)(v)), ~ P^2(A)(v),\ldots, ~ P^(A)(v),\ldots,A^(P^(A)(v)) where .


See also

*
Smith normal form In mathematics, the Smith normal form (sometimes abbreviated SNF) is a normal form that can be defined for any matrix (not necessarily square) with entries in a principal ideal domain (PID). The Smith normal form of a matrix is diagonal, and can b ...


References

* FDavid S. Dummit and Richard M. Foote. ''Abstract Algebra''. 2nd Edition, John Wiley & Sons. pp. 442, 446, 452-458. . {{Reflist


External links


Rational Canonical Form (Mathworld)


Algorithms




An Algorithm for the Frobenius Normal Form (pdf)

A rational canonical form Algorithm (pdf)
Linear algebra Matrix normal forms