In
functional analysis
Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure (e.g. inner product, norm, topology, etc.) and the linear functions defined ...
, a branch of
mathematics, a compact operator is a
linear operator
In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a Map (mathematics), mapping V \to W between two vect ...
, where
are
normed vector space
In mathematics, a normed vector space or normed space is a vector space over the real or complex numbers, on which a norm is defined. A norm is the formalization and the generalization to real vector spaces of the intuitive notion of "leng ...
s, with the property that
maps
bounded subsets of
to
relatively compact
In mathematics, a relatively compact subspace (or relatively compact subset, or precompact subset) of a topological space is a subset whose closure is compact.
Properties
Every subset of a compact topological space is relatively compact (sinc ...
subsets of
(subsets with compact
closure in
). Such an operator is necessarily a
bounded operator
In functional analysis and operator theory, a bounded linear operator is a linear transformation L : X \to Y between topological vector spaces (TVSs) X and Y that maps bounded subsets of X to bounded subsets of Y.
If X and Y are normed vecto ...
, and so continuous.
Some authors require that
are Banach, but the definition can be extended to more general spaces.
Any bounded operator ''
'' that has finite
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
is a compact operator; indeed, the class of compact operators is a natural generalization of the class of
finite-rank operators in an infinite-dimensional setting. When ''
'' is a
Hilbert space
In mathematics, Hilbert spaces (named after David Hilbert) allow generalizing the methods of linear algebra and calculus from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise natu ...
, it is true that any compact operator is a limit of finite-rank operators,
so that the class of compact operators can be defined alternatively as the closure of the set of finite-rank operators in the
norm topology
In mathematics, the operator norm measures the "size" of certain linear operators by assigning each a real number called its . Formally, it is a norm defined on the space of bounded linear operators between two given normed vector spaces.
Intro ...
. Whether this was true in general for Banach spaces (the
approximation property
In mathematics, specifically functional analysis, a Banach space is said to have the approximation property (AP), if every compact operator is a limit of finite-rank operators. The converse is always true.
Every Hilbert space has this prope ...
) was an unsolved question for many years; in 1973
Per Enflo
Per H. Enflo (; born 20 May 1944) is a Swedish mathematician working primarily in functional analysis, a field in which he solved problems that had been considered fundamental. Three of these problems had been open for more than forty years:
* Th ...
gave a counter-example, building on work by
Grothendieck and
Banach
Banach (pronounced in German, in Slavic Languages, and or in English) is a Jewish surname of Ashkenazi origin believed to stem from the translation of the phrase " son of man", combining the Hebrew word ''ben'' ("son of") and Arameic ''nash ...
.
The origin of the theory of compact operators is in the theory of
integral equation
In mathematics, integral equations are equations in which an unknown function appears under an integral sign. In mathematical notation, integral equations may thus be expressed as being of the form: f(x_1,x_2,x_3,...,x_n ; u(x_1,x_2,x_3,...,x_n ...
s, where integral operators supply concrete examples of such operators. A typical
Fredholm integral equation In mathematics, the Fredholm integral equation is an integral equation whose solution gives rise to Fredholm theory, the study of Fredholm kernels and Fredholm operators. The integral equation was studied by Ivar Fredholm. A useful method to ...
gives rise to a compact operator ''K'' on
function space
In mathematics, a function space is a set of functions between two fixed sets. Often, the domain and/or codomain will have additional structure which is inherited by the function space. For example, the set of functions from any set into a ve ...
s; the compactness property is shown by
equicontinuity
In mathematical analysis, a family of functions is equicontinuous if all the functions are continuous and they have equal variation over a given neighbourhood, in a precise sense described herein.
In particular, the concept applies to countable f ...
. The method of approximation by finite-rank operators is basic in the numerical solution of such equations. The abstract idea of
Fredholm operator
In mathematics, Fredholm operators are certain Operator (mathematics), operators that arise in the Fredholm theory of integral equations. They are named in honour of Erik Ivar Fredholm. By definition, a Fredholm operator is a bounded linear operat ...
is derived from this connection.
Equivalent formulations
A linear map
between two
topological vector space
In mathematics, a topological vector space (also called a linear topological space and commonly abbreviated TVS or t.v.s.) is one of the basic structures investigated in functional analysis.
A topological vector space is a vector space that is al ...
s is said to be compact if there exists a neighborhood ''
'' of the origin in ''
'' such that
is a relatively compact subset of ''
''.
Let
be normed spaces and
a linear operator. Then the following statements are equivalent, and some of them are used as the principal definition by different authors
* ''
'' is a compact operator;
* the image of the unit ball of ''
'' under ''
'' is
relatively compact
In mathematics, a relatively compact subspace (or relatively compact subset, or precompact subset) of a topological space is a subset whose closure is compact.
Properties
Every subset of a compact topological space is relatively compact (sinc ...
in ''
'';
* the image of any bounded subset of ''
'' under ''
'' is
relatively compact
In mathematics, a relatively compact subspace (or relatively compact subset, or precompact subset) of a topological space is a subset whose closure is compact.
Properties
Every subset of a compact topological space is relatively compact (sinc ...
in ''
'';
* there exists a
neighbourhood
A neighbourhood (British English, Irish English, Australian English and Canadian English) or neighborhood (American English; American and British English spelling differences, see spelling differences) is a geographically localised community ...
of the origin in ''
'' and a compact subset
such that
;
* for any bounded sequence
in ''
'', the sequence
contains a converging subsequence.
If in addition ''
'' is Banach, these statements are also equivalent to:
* the image of any bounded subset of ''
'' under ''
'' is
totally bounded In topology and related branches of mathematics, total-boundedness is a generalization of compactness for circumstances in which a set is not necessarily closed. A totally bounded set can be covered by finitely many subsets of every fixed “si ...
in
.
If a linear operator is compact, then it is continuous.
Important properties
In the following,
are Banach spaces,
is the space of bounded operators
under the
operator norm
In mathematics, the operator norm measures the "size" of certain linear operators by assigning each a real number called its . Formally, it is a norm defined on the space of bounded linear operators between two given normed vector spaces.
Intr ...
, and
denotes the space of compact operators
.
denotes the
identity operator
Identity may refer to:
* Identity document
* Identity (philosophy)
* Identity (social science)
* Identity (mathematics)
Arts and entertainment Film and television
* ''Identity'' (1987 film), an Iranian film
* ''Identity'' (2003 film), an ...
on
,
, and
.
*
is a closed subspace of
(in the norm topology). Equivalently,
** given a sequence of compact operators
mapping
(where
are Banach) and given that
converges to
with respect to the
operator norm
In mathematics, the operator norm measures the "size" of certain linear operators by assigning each a real number called its . Formally, it is a norm defined on the space of bounded linear operators between two given normed vector spaces.
Intr ...
, ''
'' is then compact.
* Conversely, if
are Hilbert spaces, then every compact operator from
is the limit of finite rank operators. Notably, this "
approximation property
In mathematics, specifically functional analysis, a Banach space is said to have the approximation property (AP), if every compact operator is a limit of finite-rank operators. The converse is always true.
Every Hilbert space has this prope ...
" is false for general Banach spaces ''X'' and ''Y''.
*
In particular,
forms a two-sided
ideal
Ideal may refer to:
Philosophy
* Ideal (ethics), values that one actively pursues as goals
* Platonic ideal, a philosophical idea of trueness of form, associated with Plato
Mathematics
* Ideal (ring theory), special subsets of a ring considere ...
in
.
*Any compact operator is
strictly singular In functional analysis, a branch of mathematics, a strictly singular operator is a bounded linear operator between normed spaces which is not bounded below on any infinite-dimensional subspace.
Definitions.
Let ''X'' and ''Y'' be normed linea ...
, but not vice versa.
[N.L. Carothers, ''A Short Course on Banach Space Theory'', (2005) London Mathematical Society Student Texts 64, Cambridge University Press.]
* A bounded linear operator between Banach spaces is compact if and only if its adjoint is compact (''Schauder's theorem'').
** If
is bounded and compact, then:
*** the closure of the range of ''
'' is
separable.
*** if the range of ''
'' is closed in ''Y'', then the range of ''
'' is finite-dimensional.
* If
is a Banach space and there exists an
invertible
In mathematics, the concept of an inverse element generalises the concepts of opposite () and reciprocal () of numbers.
Given an operation denoted here , and an identity element denoted , if , one says that is a left inverse of , and that ...
bounded compact operator
then ''
'' is necessarily finite-dimensional.
Now suppose that
is a Banach space and
is a compact linear operator, and
is the
adjoint
In mathematics, the term ''adjoint'' applies in several situations. Several of these share a similar formalism: if ''A'' is adjoint to ''B'', then there is typically some formula of the type
:(''Ax'', ''y'') = (''x'', ''By'').
Specifically, adjoin ...
or
transpose
In linear algebra, the transpose of a matrix is an operator which flips a matrix over its diagonal;
that is, it switches the row and column indices of the matrix by producing another matrix, often denoted by (among other notations).
The tr ...
of ''T''.
* For any
, then
is a
Fredholm operator
In mathematics, Fredholm operators are certain Operator (mathematics), operators that arise in the Fredholm theory of integral equations. They are named in honour of Erik Ivar Fredholm. By definition, a Fredholm operator is a bounded linear operat ...
of index 0. In particular,
is closed. This is essential in developing the spectral properties of compact operators. One can notice the similarity between this property and the fact that, if ''
'' and ''
'' are subspaces of ''
'' where
is closed and ''
'' is finite-dimensional, then
is also closed.
* If
is any bounded linear operator then both
and
are compact operators.
* If
then the range of
is closed and the kernel of
is finite-dimensional.
* If
then the following are finite and equal:
* The
spectrum
A spectrum (plural ''spectra'' or ''spectrums'') is a condition that is not limited to a specific set of values but can vary, without gaps, across a continuum. The word was first used scientifically in optics to describe the rainbow of color ...
of ''
'', is compact,
countable
In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural number ...
, and has at most one
limit point
In mathematics, a limit point, accumulation point, or cluster point of a set S in a topological space X is a point x that can be "approximated" by points of S in the sense that every neighbourhood of x with respect to the topology on X also conta ...
, which would necessarily be the origin.
* If
is infinite-dimensional then
.
* If
and
then
is an eigenvalue of both ''
'' and
.
* For every
the set
is finite, and for every non-zero
the range of
is a
proper subset
In mathematics, set ''A'' is a subset of a set ''B'' if all elements of ''A'' are also elements of ''B''; ''B'' is then a superset of ''A''. It is possible for ''A'' and ''B'' to be equal; if they are unequal, then ''A'' is a proper subset o ...
of ''X''.
Origins in integral equation theory
A crucial property of compact operators is the
Fredholm alternative In mathematics, the Fredholm alternative, named after Ivar Fredholm, is one of Fredholm's theorems and is a result in Fredholm theory. It may be expressed in several ways, as a theorem of linear algebra, a theorem of integral equations, or as a theo ...
, which asserts that the existence of solution of linear equations of the form
(where K is a compact operator, f is a given function, and u is the unknown function to be solved for) behaves much like as in finite dimensions. The
spectral theory of compact operators
In functional analysis, compact operators are linear operators on Banach spaces that map bounded sets to relatively compact sets. In the case of a Hilbert space ''H'', the compact operators are the closure of the finite rank operators in the unifo ...
then follows, and it is due to
Frigyes Riesz
Frigyes Riesz ( hu, Riesz Frigyes, , sometimes spelled as Frederic; 22 January 1880 – 28 February 1956) was a HungarianEberhard Zeidler: Nonlinear Functional Analysis and Its Applications: Linear monotone operators. Springer, 199/ref> mathema ...
(1918). It shows that a compact operator ''K'' on an infinite-dimensional Banach space has spectrum that is either a finite subset of C which includes 0, or the spectrum is a
countably infinite
In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural numbers ...
subset of C which has 0 as its only
limit point
In mathematics, a limit point, accumulation point, or cluster point of a set S in a topological space X is a point x that can be "approximated" by points of S in the sense that every neighbourhood of x with respect to the topology on X also conta ...
. Moreover, in either case the non-zero elements of the spectrum are
eigenvalue
In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denot ...
s of ''K'' with finite multiplicities (so that ''K'' − λ''I'' has a finite-dimensional
kernel
Kernel may refer to:
Computing
* Kernel (operating system), the central component of most operating systems
* Kernel (image processing), a matrix used for image convolution
* Compute kernel, in GPGPU programming
* Kernel method, in machine lea ...
for all complex λ ≠ 0).
An important example of a compact operator is
compact embedding In mathematics, the notion of being compactly embedded expresses the idea that one set or space is "well contained" inside another. There are versions of this concept appropriate to general topology and functional analysis.
Definition (topologica ...
of
Sobolev space
In mathematics, a Sobolev space is a vector space of functions equipped with a norm that is a combination of ''Lp''-norms of the function together with its derivatives up to a given order. The derivatives are understood in a suitable weak sense ...
s, which, along with the
Gårding inequality and the
Lax–Milgram theorem Weak formulations are important tools for the analysis of mathematical equations that permit the transfer of concepts of linear algebra to solve problems in other fields such as partial differential equations. In a weak formulation, equations or co ...
, can be used to convert an
elliptic boundary value problem
In mathematics, an elliptic boundary value problem is a special kind of boundary value problem which can be thought of as the stable state of an evolution problem. For example, the Dirichlet problem for the Laplacian gives the eventual distrib ...
into a Fredholm integral equation.
[William McLean, Strongly Elliptic Systems and Boundary Integral Equations, Cambridge University Press, 2000] Existence of the solution and spectral properties then follow from the theory of compact operators; in particular, an elliptic boundary value problem on a bounded domain has infinitely many isolated eigenvalues. One consequence is that a solid body can vibrate only at isolated frequencies, given by the eigenvalues, and arbitrarily high vibration frequencies always exist.
The compact operators from a Banach space to itself form a two-sided
ideal
Ideal may refer to:
Philosophy
* Ideal (ethics), values that one actively pursues as goals
* Platonic ideal, a philosophical idea of trueness of form, associated with Plato
Mathematics
* Ideal (ring theory), special subsets of a ring considere ...
in the
algebra
Algebra () is one of the areas of mathematics, broad areas of mathematics. Roughly speaking, algebra is the study of mathematical symbols and the rules for manipulating these symbols in formulas; it is a unifying thread of almost all of mathem ...
of all bounded operators on the space. Indeed, the compact operators on an infinite-dimensional separable Hilbert space form a maximal ideal, so the
quotient algebra, known as the
Calkin algebra In functional analysis, the Calkin algebra, named after John Williams Calkin, is the quotient of ''B''(''H''), the ring of bounded linear operators on a separable infinite-dimensional Hilbert space ''H'', by the ideal ''K''(''H'') of compact ope ...
, is
simple
Simple or SIMPLE may refer to:
* Simplicity, the state or quality of being simple
Arts and entertainment
* ''Simple'' (album), by Andy Yorke, 2008, and its title track
* "Simple" (Florida Georgia Line song), 2018
* "Simple", a song by John ...
. More generally, the compact operators form an
operator ideal In functional analysis, a branch of mathematics, an operator ideal is a special kind of class of continuous linear operators between Banach spaces. If an operator T belongs to an operator ideal \mathcal, then for any operators A and B which can ...
.
Compact operator on Hilbert spaces
For Hilbert spaces, another equivalent definition of compact operators is given as follows.
An operator
on an infinite-dimensional
Hilbert space
In mathematics, Hilbert spaces (named after David Hilbert) allow generalizing the methods of linear algebra and calculus from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise natu ...
:
is said to be ''compact'' if it can be written in the form
:
where
and
are orthonormal sets (not necessarily complete), and
is a sequence of positive numbers with limit zero, called the
singular value In mathematics, in particular functional analysis, the singular values, or ''s''-numbers of a compact operator T: X \rightarrow Y acting between Hilbert spaces X and Y, are the square roots of the (necessarily non-negative) eigenvalues of the se ...
s of the operator. The singular values can
accumulate only at zero. If the sequence becomes stationary at zero, that is
for some
and every
, then the operator has finite rank, ''i.e'', a finite-dimensional range and can be written as
:
The bracket
is the scalar product on the Hilbert space; the sum on the right hand side converges in the operator norm.
An important subclass of compact operators is the
trace-class In mathematics, specifically functional analysis, a trace-class operator is a linear operator for which a trace may be defined, such that the trace is a finite number independent of the choice of basis used to compute the trace. This trace of trac ...
or
nuclear operator
In mathematics, nuclear operators are an important class of linear operators introduced by Alexander Grothendieck in his doctoral dissertation. Nuclear operators are intimately tied to the projective tensor product of two topological vector spac ...
s.
Completely continuous operators
Let ''X'' and ''Y'' be Banach spaces. A bounded linear operator ''T'' : ''X'' → ''Y'' is called completely continuous if, for every
weakly convergent sequence
In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is called ...
from ''X'', the sequence
is norm-convergent in ''Y'' . Compact operators on a Banach space are always completely continuous. If ''X'' is a
reflexive Banach space, then every completely continuous operator ''T'' : ''X'' → ''Y'' is compact.
Somewhat confusingly, compact operators are sometimes referred to as "completely continuous" in older literature, even though they are not necessarily completely continuous by the definition of that phrase in modern terminology.
Examples
* Every finite rank operator is compact.
* For
and a sequence ''(t
n)'' converging to zero, the multiplication operator (''Tx'')''
n = t
n x
n'' is compact.
* For some fixed ''g'' ∈ ''C''(
, 1 R), define the linear operator ''T'' from ''C''(
, 1 R) to ''C''(
, 1 R) by
That the operator ''T'' is indeed compact follows from the
Ascoli theorem.
* More generally, if Ω is any domain in R
''n'' and the integral kernel ''k'' : Ω × Ω → R is a
Hilbert–Schmidt kernel, then the operator ''T'' on ''L''
2(Ω; R) defined by
is a compact operator.
* By
Riesz's lemma
Riesz's lemma (after Frigyes Riesz) is a lemma in functional analysis. It specifies (often easy to check) conditions that guarantee that a subspace in a normed vector space is dense. The lemma may also be called the Riesz lemma or Riesz inequal ...
, the identity operator is a compact operator if and only if the space is finite-dimensional.
See also
*
*
*
*
*
*
*
Notes
References
*
*
*
*
*
*
*
* (Section 7.5)
*
*
*
{{Topological vector spaces
Compactness (mathematics)
Operator theory