HOME

TheInfoList



OR:

In the fields of
machine learning Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence. Machine ...
, the
theory of computation In theoretical computer science and mathematics, the theory of computation is the branch that deals with what problems can be solved on a model of computation, using an algorithm, how efficiently they can be solved or to what degree (e.g., ...
, and random matrix theory, a probability distribution over vectors is said to be in isotropic position if its
covariance matrix In probability theory and statistics, a covariance matrix (also known as auto-covariance matrix, dispersion matrix, variance matrix, or variance–covariance matrix) is a square matrix giving the covariance between each pair of elements o ...
is equal to the
identity matrix In linear algebra, the identity matrix of size n is the n\times n square matrix with ones on the main diagonal and zeros elsewhere. Terminology and notation The identity matrix is often denoted by I_n, or simply by I if the size is immaterial ...
.


Formal definitions

Let D be a distribution over vectors in the vector space \mathbb^n. Then D is in isotropic position if, for vector v sampled from the distribution, \mathbb\, vv^\mathsf = \mathrm. A ''set'' of vectors is said to be in isotropic position if the uniform distribution over that set is in isotropic position. In particular, every
orthonormal In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
set of vectors is isotropic. As a related definition, a
convex body In mathematics, a convex body in n-dimensional Euclidean space \R^n is a compact convex set with non- empty interior. A convex body K is called symmetric if it is centrally symmetric with respect to the origin; that is to say, a point x lies in ...
K in \mathbb^n is called isotropic if it has volume , K, = 1, center of mass at the origin, and there is a constant \alpha > 0 such that \int_K \langle x, y \rangle^2 dx = \alpha^2 , y, ^2, for all vectors y in \mathbb^n; here , \cdot, stands for the standard Euclidean norm.


See also

*
Whitening transformation A whitening transformation or sphering transformation is a linear transformation that transforms a vector of random variables with a known covariance matrix into a set of new variables whose covariance is the identity matrix, meaning that they are ...


References

* {{cite journal , first=M. , last=Rudelson , title=Random Vectors in the Isotropic Position , journal=
Journal of Functional Analysis The ''Journal of Functional Analysis'' is a mathematics journal published by Elsevier. Founded by Paul Malliavin, Ralph S. Phillips, and Irving Segal, its editors-in-chief are Daniel W. Stroock, Stefaan Vaes, and Cedric Villani. It is covered in ...
, volume=164 , year=1999 , issue=1 , pages=60–72 , doi=10.1006/jfan.1998.3384 , arxiv=math/9608208 , s2cid=7652247 Machine learning Random matrices