
Matrix completion is the task of filling in the missing entries of a partially observed matrix, which is equivalent to performing data
imputation in statistics. A wide range of datasets are naturally organized in matrix form. One example is the movie-ratings matrix, as appears in the
Netflix problem: Given a ratings matrix in which each entry
represents the rating of movie
by customer
, if customer
has watched movie
and is otherwise missing, we would like to predict the remaining entries in order to make good recommendations to customers on what to watch next. Another example is the
document-term matrix
A document-term matrix is a mathematical matrix that describes the frequency of terms that occur in a collection of documents. In a document-term matrix, rows correspond to documents in the collection and columns correspond to terms. This matrix i ...
: The frequencies of words used in a collection of documents can be represented as a matrix, where each entry corresponds to the number of times the associated term appears in the indicated document.
Without any restrictions on the number of
degrees of freedom
Degrees of freedom (often abbreviated df or DOF) refers to the number of independent variables or parameters of a thermodynamic system. In various scientific fields, the word "freedom" is used to describe the limits to which physical movement or ...
in the completed matrix this problem is
underdetermined since the hidden entries could be assigned arbitrary values. Thus we require some assumption on the matrix to create a
well-posed problem
The mathematical term well-posed problem stems from a definition given by 20th-century French mathematician Jacques Hadamard. He believed that mathematical models of physical phenomena should have the properties that:
# a solution exists,
# the s ...
, such as assuming it has maximal determinant, is positive definite, or is low-rank.
For example, one may assume the matrix has low-rank structure, and then seek to find the lowest
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
matrix or, if the rank of the completed matrix is known, a matrix of
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
that matches the known entries. The illustration shows that a partially revealed rank-1 matrix (on the left) can be completed with zero-error (on the right) since all the rows with missing entries should be the same as the third row. In the case of the Netflix problem the ratings matrix is expected to be low-rank since user preferences can often be described by a few factors, such as the movie genre and time of release. Other applications include computer vision, where missing pixels in images need to be reconstructed, detecting the global positioning of sensors in a network from partial distance information, and
multiclass learning. The matrix completion problem is in general
NP-hard
In computational complexity theory, NP-hardness ( non-deterministic polynomial-time hardness) is the defining property of a class of problems that are informally "at least as hard as the hardest problems in NP". A simple example of an NP-hard pr ...
, but under additional assumptions there are efficient algorithms that achieve exact reconstruction with high probability.
In statistical learning point of view, the matrix completion problem is an application of
matrix regularization which is a generalization of vector
regularization. For example, in the low-rank matrix completion problem one may apply the regularization penalty taking the form of a nuclear norm
Low rank matrix completion
One of the variants of the matrix completion problem is to find the lowest
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
matrix
which matches the matrix
, which we wish to recover, for all entries in the set
of observed entries. The mathematical formulation of this problem is as follows:
:
Candès and Recht
proved that with assumptions on the sampling of the observed entries and sufficiently many sampled entries this problem has a unique solution with high probability.
An equivalent formulation, given that the matrix
to be recovered is known to be of
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
, is to solve for
where
Assumptions
A number of assumptions on the sampling of the observed entries and the number of sampled entries are frequently made to simplify the analysis and to ensure the problem is not
underdetermined.
Uniform sampling of observed entries
To make the analysis tractable, it is often assumed that the set
of observed entries and fixed
cardinality
In mathematics, the cardinality of a set is a measure of the number of elements of the set. For example, the set A = \ contains 3 elements, and therefore A has a cardinality of 3. Beginning in the late 19th century, this concept was generalized ...
is sampled uniformly at random from the collection of all subsets of entries of cardinality
. To further simplify the analysis, it is instead assumed that
is constructed by
Bernoulli sampling In the theory of finite population sampling, Bernoulli sampling is a sampling process where each element of the population is subjected to an independent Bernoulli trial which determines whether the element becomes part of the sample. An essential p ...
, i.e. that each entry is observed with probability
. If
is set to
where
is the desired expected
cardinality
In mathematics, the cardinality of a set is a measure of the number of elements of the set. For example, the set A = \ contains 3 elements, and therefore A has a cardinality of 3. Beginning in the late 19th century, this concept was generalized ...
of
, and
are the dimensions of the matrix (let
without loss of generality),
is within
of
with high probability, thus
Bernoulli sampling In the theory of finite population sampling, Bernoulli sampling is a sampling process where each element of the population is subjected to an independent Bernoulli trial which determines whether the element becomes part of the sample. An essential p ...
is a good approximation for uniform sampling.
Another simplification is to assume that entries are sampled independently and with replacement.
Lower bound on number of observed entries
Suppose the
by
matrix
(with
) we are trying to recover has
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
. There is an information theoretic lower bound on how many entries must be observed before
can be uniquely reconstructed. The set of
by
matrices with rank less than or equal to
is an algebraic variety in
with dimension
.
Using this result,
one can show that at least
entries must be observed for matrix completion in
to have a unique solution
when
.
Secondly, there must be at least one observed entry per row and column of
. The
singular value decomposition
In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix. It generalizes the eigendecomposition of a square normal matrix with an orthonormal eigenbasis to any \ m \times n\ matrix. It is r ...
of
is given by
. If row
is unobserved, it is easy to see the
right singular vector of
,
, can be changed to some arbitrary value and still yield a matrix matching
over the set of observed entries. Similarly, if column
is unobserved, the
left singular vector of
,
can be arbitrary. If we assume Bernoulli sampling of the set of observed entries, the
Coupon collector effect implies that entries on the order of
must be observed to ensure that there is an observation from each row and column with high probability.
Combining the necessary conditions and assuming that
(a valid assumption for many practical applications), the lower bound on the number of observed entries required to prevent the problem of matrix completion from being underdetermined is on the order of
.
Incoherence
The concept of incoherence arose in
compressed sensing
Compressed sensing (also known as compressive sensing, compressive sampling, or sparse sampling) is a signal processing technique for efficiently acquiring and reconstructing a signal, by finding solutions to underdetermined linear systems. This ...
. It is introduced in the context of matrix completion to ensure the singular vectors of
are not too "sparse" in the sense that all coordinates of each singular vector are of comparable magnitude instead of just a few coordinates having significantly larger magnitudes.
The standard basis vectors are then undesirable as singular vectors, and the vector
in
is desirable. As an example of what could go wrong if the singular vectors are sufficiently "sparse", consider the
by
matrix
with
singular value decomposition
In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix. It generalizes the eigendecomposition of a square normal matrix with an orthonormal eigenbasis to any \ m \times n\ matrix. It is r ...
. Almost all the entries of
must be sampled before it can be reconstructed.
Candès and Recht
define the coherence of a matrix
with
column space
In linear algebra, the column space (also called the range or image) of a matrix ''A'' is the span (set of all possible linear combinations) of its column vectors. The column space of a matrix is the image or range of the corresponding mat ...
an
dimensional subspace of
as
, where
is the orthogonal
projection onto
. Incoherence then asserts that given the
singular value decomposition
In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix. It generalizes the eigendecomposition of a square normal matrix with an orthonormal eigenbasis to any \ m \times n\ matrix. It is r ...
of the
by
matrix
,
#
# The entries of
have magnitudes upper bounded by
for some
.
Low rank matrix completion with noise
In real world application, one often observe only a few entries corrupted at least by a small amount of noise. For example, in the Netflix problem, the ratings are uncertain. Candès and Plan
showed that it is possible to fill in the many missing entries of large low-rank matrices from just a few noisy samples by nuclear norm minimization. The noisy model assumes that we observe
where
is a noise term. Note that the noise can be either stochastic or deterministic. Alternatively the model can be expressed as
where
is an
matrix with entries
for
assuming that
for some
.To recover the incomplete matrix, we try to solve the following optimization problem:
Among all matrices consistent with the data, find the one with minimum nuclear norm. Candès and Plan
have shown that this reconstruction is accurate. They have proved that when perfect noiseless recovery occurs, then matrix completion is stable vis a vis perturbations. The error is proportional to the noise level
. Therefore, when the noise level is small, the error is small. Here the matrix completion problem does not obey the restricted isometry property (RIP). For matrices, the RIP would assume that the sampling operator obeys
for all matrices
with sufficiently small rank and
sufficiently small.
The methods are also applicable to sparse signal recovery problems in which the RIP does not hold.
High rank matrix completion
The high rank matrix completion in general is
NP-Hard
In computational complexity theory, NP-hardness ( non-deterministic polynomial-time hardness) is the defining property of a class of problems that are informally "at least as hard as the hardest problems in NP". A simple example of an NP-hard pr ...
. However, with certain assumptions, some incomplete high rank matrix or even full rank matrix can be completed.
Eriksson, Balzano and Nowak
have considered the problem of completing a matrix with the assumption that the columns of the matrix belong to a union of multiple low-rank subspaces. Since the columns belong to a union of subspaces, the problem may be viewed as a missing-data version of the
subspace clustering problem. Let
be an
matrix whose (complete) columns lie in a union of at most
subspaces, each of
, and assume
. Eriksson, Balzano and Nowak
showed that under mild assumptions each column of
can be perfectly recovered with high probability from an incomplete version so long as at least
entries of
are observed uniformly at random, with
a constant depending on the usual incoherence conditions, the geometrical arrangement of subspaces, and the distribution of columns over the subspaces.
The algorithm involves several steps: (1) local neighborhoods; (2) local subspaces; (3) subspace refinement; (4) full matrix completion. This method can be applied to Internet distance matrix completion and topology identification.
Algorithms for Low-Rank Matrix Completion
Various matrix completion algorithms have been proposed.
These includes convex relaxation-based algorithm,
gradient-based algorithm,
and alternating minimization-based algorithm.
Convex relaxation
The rank minimization problem is
NP-hard
In computational complexity theory, NP-hardness ( non-deterministic polynomial-time hardness) is the defining property of a class of problems that are informally "at least as hard as the hardest problems in NP". A simple example of an NP-hard pr ...
. One approach, proposed by Candès and Recht, is to form a
convex
Convex or convexity may refer to:
Science and technology
* Convex lens, in optics
Mathematics
* Convex set, containing the whole line segment that joins points
** Convex polygon, a polygon which encloses a convex set of points
** Convex polytop ...
relaxation of the problem and minimize the nuclear
norm (which gives the sum of the
singular value In mathematics, in particular functional analysis, the singular values, or ''s''-numbers of a compact operator T: X \rightarrow Y acting between Hilbert spaces X and Y, are the square roots of the (necessarily non-negative) eigenvalues of the se ...
s of
) instead of
(which counts the number of non zero
singular value In mathematics, in particular functional analysis, the singular values, or ''s''-numbers of a compact operator T: X \rightarrow Y acting between Hilbert spaces X and Y, are the square roots of the (necessarily non-negative) eigenvalues of the se ...
s of
).
This is analogous to minimizing the L1-
norm rather than the L0-
norm for vectors. The
convex
Convex or convexity may refer to:
Science and technology
* Convex lens, in optics
Mathematics
* Convex set, containing the whole line segment that joins points
** Convex polygon, a polygon which encloses a convex set of points
** Convex polytop ...
relaxation can be solved using
semidefinite programming Semidefinite programming (SDP) is a subfield of convex optimization concerned with the optimization of a linear objective function (a user-specified function that the user wants to minimize or maximize)
over the intersection of the cone of positiv ...
(SDP) by noticing that the optimization problem is equivalent to
The complexity of using
SDP to solve the convex relaxation is
. State of the art solvers like SDPT3 can only handle matrices of size up to 100 by 100
An alternative first order method that approximately solves the convex relaxation is the Singular Value Thresholding Algorithm introduced by Cai, Candès and Shen.
Candès and Recht show, using the study of random variables on
Banach space
In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between ve ...
s, that if the number of observed entries is on the order of
(assume without loss of generality
), the rank minimization problem has a unique solution which also happens to be the solution of its convex relaxation with probability
for some constant
. If the rank of
is small (
), the size of the set of observations reduces to the order of
. These results are near optimal, since the minimum number of entries that must be observed for the matrix completion problem to not be underdetermined is on the order of
.
This result has been improved by Candès and Tao.
They achieve bounds that differ from the optimal bounds only by
polylogarithm
In mathematics, the polylogarithm (also known as Jonquière's function, for Alfred Jonquière) is a special function of order and argument . Only for special values of does the polylogarithm reduce to an elementary function such as the natu ...
ic factors by strengthening the assumptions. Instead of the incoherence property, they assume the strong incoherence property with parameter
. This property states that:
#
for
and
for
# The entries of
are bounded in magnitude by
Intuitively, strong incoherence of a matrix
asserts that the orthogonal projections of standard basis vectors to
has magnitudes that have high likelihood if the singular vectors were distributed randomly.
Candès and Tao find that when
is
and the number of observed entries is on the order of
, the rank minimization problem has a unique solution which also happens to be the solution of its convex relaxation with probability
for some constant
. For arbitrary
, the number of observed entries sufficient for this assertion hold true is on the order of
Another convex relaxation approach
is to minimize the Frobenius squared norm under a rank constraint. This is equivalent to solving
By introducing an orthogonal projection matrix
(meaning
) to model the rank of
via
and taking this problem's convex relaxation, we obtain the following semidefinite program
If Y is a projection matrix (i.e., has binary eigenvalues) in this relaxation, then the relaxation is tight. Otherwise, it gives a valid lower bound on the overall objective. Moreover, it can be converted into a feasible solution with a (slightly) larger objective by rounding the eigenvalues of Y greedily.
Remarkably, this convex relaxation can be solved by alternating minimization on X and Y without solving any SDPs, and thus it scales beyond the typical numerical limits of state-of-the-art SDP solvers like SDPT3 or Mosek.
This approach is a special case of a more general reformulation technique, which can be applied to obtain a valid lower bound on any low-rank problem with a trace-matrix-convex objective.
Gradient descent
Keshavan, Montanari and Oh
consider a variant of matrix completion where the
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
of the
by
matrix
, which is to be recovered, is known to be
. They assume
Bernoulli sampling In the theory of finite population sampling, Bernoulli sampling is a sampling process where each element of the population is subjected to an independent Bernoulli trial which determines whether the element becomes part of the sample. An essential p ...
of entries, constant aspect ratio
, bounded magnitude of entries of
(let the upper bound be
), and constant
condition number
In numerical analysis, the condition number of a function measures how much the output value of the function can change for a small change in the input argument. This is used to measure how sensitive a function is to changes or errors in the inpu ...
(where
and
are the largest and smallest
singular value In mathematics, in particular functional analysis, the singular values, or ''s''-numbers of a compact operator T: X \rightarrow Y acting between Hilbert spaces X and Y, are the square roots of the (necessarily non-negative) eigenvalues of the se ...
s of
respectively). Further, they assume the two incoherence conditions are satisfied with
and
where
and
are constants. Let
be a matrix that matches
on the set
of observed entries and is 0 elsewhere. They then propose the following algorithm:
# Trim
by removing all observations from columns with degree larger than
by setting the entries in the columns to 0. Similarly remove all observations from rows with degree larger than
.
# Project
onto its first
principal components. Call the resulting matrix
.
# Solve
where
is some
regularization function by
gradient descent
In mathematics, gradient descent (also often called steepest descent) is a first-order iterative optimization algorithm for finding a local minimum of a differentiable function. The idea is to take repeated steps in the opposite direction of ...
with
line search
In optimization, the line search strategy is one of two basic iterative approaches to find a local minimum \mathbf^* of an objective function f:\mathbb R^n\to\mathbb R. The other approach is trust region.
The line search approach first finds a ...
. Initialize
at
where
. Set
as some function forcing
to remain incoherent throughout gradient descent if
and
are incoherent.
# Return the matrix
.
Steps 1 and 2 of the algorithm yield a matrix
very close to the true matrix
(as measured by the
root mean square error (RMSE)) with high probability. In particular, with probability
,
for some constant
.
denotes the Frobenius
norm. Note that the full suite of assumptions is not needed for this result to hold. The incoherence condition, for example, only comes into play in exact reconstruction. Finally, although trimming may seem counter intuitive as it involves throwing out information, it ensures projecting
onto its first
principal components gives more information about the underlying matrix
than about the observed entries.
In Step 3, the space of candidate matrices
can be reduced by noticing that the inner minimization problem has the same solution for
as for
where
and
are
orthonormal
In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
by
matrices. Then
gradient descent
In mathematics, gradient descent (also often called steepest descent) is a first-order iterative optimization algorithm for finding a local minimum of a differentiable function. The idea is to take repeated steps in the opposite direction of ...
can be performed over the
cross product
In mathematics, the cross product or vector product (occasionally directed area product, to emphasize its geometric significance) is a binary operation on two vectors in a three-dimensional oriented Euclidean vector space (named here E), and i ...
of two
Grassman manifolds. If
and the observed entry set is in the order of
, the matrix returned by Step 3 is exactly
. Then the algorithm is order optimal, since we know that for the matrix completion problem to not be
underdetermined the number of entries must be in the order of
.
Alternating least squares minimization
Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to be one of the most accurate and efficient, and formed a major component of the winning entry in the Netflix problem. In the alternating minimization approach, the low-rank target matrix is written in a
bilinear form
In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called '' scalars''). In other words, a bilinear form is a function that is lin ...
:
;
the algorithm then alternates between finding the best
and the best
. While the overall problem is non-convex, each sub-problem is typically convex and can be solved efficiently. Jain, Netrapalli and Sanghavi
have given one of the first guarantees for performance of alternating minimization for both matrix completion and matrix sensing.
The alternating minimization algorithm can be viewed as an approximate way to solve the following non-convex problem:
The AltMinComplete Algorithm proposed by Jain, Netrapalli and Sanghavi is listed here:
# Input: observed set
, values
# Partition
into
subsets
with each element of
belonging to one of the
with equal probability (sampling with replacement)
#
i.e., top-
left singular vectors of
# Clipping: Set all elements of
that have magnitude greater than
to zero and orthonormalize the columns of
# for
do
#
#
# end for
# Return
They showed that by observing
random entries of an incoherent matrix
, AltMinComplete algorithm can recover
in
steps. In terms of sample complexity (
), theoretically, Alternating Minimization may require a bigger
than Convex Relaxation. However empirically it seems not the case which implies that the sample complexity bounds can be further tightened. In terms of time complexity, they showed that AltMinComplete needs time
.
It is worth noting that, although convex relaxation based methods have rigorous analysis, alternating minimization based algorithms are more successful in practice.
Applications
Several applications of matrix completion are summarized by Candès and Plan
as follows:
Collaborative filtering
Collaborative filtering
Collaborative filtering (CF) is a technique used by recommender systems.Francesco Ricci and Lior Rokach and Bracha ShapiraIntroduction to Recommender Systems Handbook Recommender Systems Handbook, Springer, 2011, pp. 1-35 Collaborative filtering ...
is the task of making automatic predictions about the interests of a user by collecting taste information from many users. Companies like Apple, Amazon, Barnes and Noble, and Netflix are trying to predict their user preferences from partial knowledge. In these kind of matrix completion problem, the unknown full matrix is often considered low rank because only a few factors typically contribute to an individual's tastes or preference.
System identification
In control, one would like to fit a discrete-time linear time-invariant state-space model
to a sequence of inputs
and outputs
. The vector
is the state of the system at time
and
is the order of the system model. From the input/output pair, one would like to recover the matrices
and the initial state
. This problem can also be viewed as a low-rank matrix completion problem.
Internet of things (IoT) localization
The localization (or global positioning) problem emerges naturally in IoT sensor networks. The problem is to recover the sensor map in
Euclidean space
Euclidean space is the fundamental space of geometry, intended to represent physical space. Originally, that is, in Euclid's ''Elements'', it was the three-dimensional space of Euclidean geometry, but in modern mathematics there are Euclidean sp ...
from a local or partial set of pairwise distances. Thus it is a matrix completion problem with rank two if the sensors are located in a 2-D plane and three if they are in a 3-D space.
Social Networks Recovery
Most of the real-world social networks have low-rank distance matrices. When we are not able to measure the complete network, which can be due to reasons such as private nodes, limited storage or compute resources, we only have a fraction of distance entries known. Criminal networks are a good example of such networks. Low-rank Matrix Completion can be used to recover these unobserved distances.
See also
*
Matrix regularization
*
Netflix Prize
*
Collaborative filtering
Collaborative filtering (CF) is a technique used by recommender systems.Francesco Ricci and Lior Rokach and Bracha ShapiraIntroduction to Recommender Systems Handbook Recommender Systems Handbook, Springer, 2011, pp. 1-35 Collaborative filtering ...
*
System identification
The field of system identification uses statistical methods to build mathematical models of dynamical systems from measured data. System identification also includes the optimal design of experiments for efficiently generating informative data f ...
*
Convex optimization
Convex optimization is a subfield of mathematical optimization that studies the problem of minimizing convex functions over convex sets (or, equivalently, maximizing concave functions over convex sets). Many classes of convex optimization prob ...
*
Imputation
References
{{Reflist, refs=
[
{{cite journal
, last1=Johnson , first1=Charles R.
, year=1990
, title=Matrix completion problems: a survey.
, journal= Matrix Theory and Applications
, series=Proceedings of Symposia in Applied Mathematics
, volume=40 , pages=171–198
, doi=10.1090/psapm/040/1059486
, isbn=9780821801543
]
[
{{cite journal
, last1=Laurent , first1=Monique
, year=2008
, title=Matrix Completion Problems.
, journal= Encyclopedia of Optimization
, volume=3 , pages=221–229
, doi=10.1007/978-0-387-74759-0_355
, isbn=978-0-387-74758-3
]
[
{{cite journal
, last1=Bertsimas , first1=Dimitris
, last2=Cory-Wright , first2=Ryan
, last3=Pauphilet , first3=Jean
, year=2021
, title=Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints
, journal=]Operations Research
Operations research ( en-GB, operational research) (U.S. Air Force Specialty Code: Operations Analysis), often shortened to the initialism OR, is a discipline that deals with the development and application of analytical methods to improve dec ...
, arxiv=2009.10395
, doi=10.1287/opre.2021.2182
[
{{cite journal
, last1=Bertsimas , first1=Dimitris
, last2=Cory-Wright , first2=Ryan
, last3=Pauphilet , first3=Jean
, year=2021
, title=A New Perspective on Low-Rank Optimization
, journal= Optimization Online
, arxiv=2105.05947
]
[
{{cite journal
, last1=Candès , first1=E. J.
, last2=Recht , first2=B.
, year=2009
, title=Exact Matrix Completion via Convex Optimization
, journal= Foundations of Computational Mathematics
, volume=9 , issue=6 , pages=717–772
, arxiv=0805.4471
, doi=10.1007/s10208-009-9045-5
, doi-access=free
]
[
{{cite journal
, last1=Candès , first1=E. J.
, last2=Tao , first2=T.
, year=2010
, title=The Power of Convex Relaxation: Near-Optimal Matrix Completion
, journal=]IEEE Transactions on Information Theory
''IEEE Transactions on Information Theory'' is a monthly peer-reviewed scientific journal published by the IEEE Information Theory Society. It covers information theory and the mathematics of communications. It was established in 1953 as ''IRE Tra ...
, volume=56 , issue=5 , pages=2053–2080
, arxiv=0903.1476
, doi=10.1109/TIT.2010.2044061
, s2cid=1255437
[
{{cite journal
, last1=Keshavan , first1=R. H.
, last2=Montanari , first2=A.
, last3=Oh , first3=S.
, year=2010
, title=Matrix Completion from a Few Entries
, journal=]IEEE Transactions on Information Theory
''IEEE Transactions on Information Theory'' is a monthly peer-reviewed scientific journal published by the IEEE Information Theory Society. It covers information theory and the mathematics of communications. It was established in 1953 as ''IRE Tra ...
, volume=56 , issue=6 , pages=2980–2998
, arxiv=0901.3150
, doi=10.1109/TIT.2010.2046205
, s2cid=53504
[
{{cite journal
, last1=Recht , first1=B.
, year=2009
, title=A Simpler Approach to Matrix Completion
, url=http://www.jmlr.org/papers/volume12/recht11a/recht11a.pdf
, journal=]Journal of Machine Learning Research
The ''Journal of Machine Learning Research'' is a peer-reviewed open access scientific journal covering machine learning. It was established in 2000 and the first editor-in-chief was Leslie Kaelbling
Leslie Pack Kaelbling is an American robotic ...
, volume=12 , pages=3413–3430
, arxiv=0910.0651
, bibcode=2009arXiv0910.0651R
[
{{cite journal
, last1=Candès , first1=E. J.
, last2=Plan , first2=Y.
, year=2010
, title=Matrix Completion with Noise
, journal=]Proceedings of the IEEE
The ''Proceedings of the IEEE'' is a monthly peer review, peer-reviewed scientific journal published by the Institute of Electrical and Electronics Engineers (IEEE). The journal focuses on electrical engineering and computer science. According to ...
, volume=98 , issue=6 , pages=925–936
, arxiv=0903.3131
, doi=10.1109/JPROC.2009.2035722
, s2cid=109721
[
{{cite arXiv
, last1=Eriksson , first1=B.
, last2=Balzano , first2=L.
, last3=Nowak , first3=R.
, year=2011
, title=High-Rank Matrix Completion and Subspace Clustering with Missing Data
, eprint=1112.5629
, class=cs.IT
]
[
{{cite journal
, last1=Nguyen , first1=L.T.
, last2=Kim , first2=J.
, last3=Shim , first3=B.
, date=10 July 2019
, title=Low-Rank Matrix Completion: A Contemporary Survey
, journal=]IEEE Access
IEEE Access is a peer-reviewed open-access scientific journal published by the Institute of Electrical and Electronics Engineers (IEEE). It was established in 2013 and covers all IEEE fields of interest. The founding editor-in-chief was Michael Pe ...
, volume=7 , issue=1 , pages=94215–94237
, doi=10.1109/ACCESS.2019.2928130
, bibcode=2019arXiv190711705N
, arxiv=1907.11705
, s2cid=198930899
[
{{cite web
, last=Tao , first=T.
, date=10 March 2009
, title=The power of convex relaxation: near-optimal matrix completion
, url=http://terrytao.wordpress.com/2009/03/10/the-power-of-convex-relaxation-near-optimal-matrix-completion/
, website=What's new
]
[
{{cite journal
, last1=Cai , first1=J.-F.
, last2=Candès , first2=E. J.
, last3=Shen , first3=Z.
, year=2010
, title=A Singular Value Thresholding Algorithm for Matrix Completion
, journal= SIAM Journal on Optimization
, volume=20 , issue=4 , pages=1956–1982
, arxiv=0810.3286
, doi=10.1137/080738970
, s2cid=1254778
]
[
{{cite book
, last1=Jain , first1=P.
, last2=Netrapalli , first2=P.
, last3=Sanghavi , first3=S.
, year=2013
, chapter=Low-rank Matrix Completion using Alternating Minimization
, title=Proceedings of the 45th annual ACM symposium on Symposium on theory of computing
, pages=665–674
, publisher=ACM
, arxiv=1212.0467
, doi=10.1145/2488608.2488693
, isbn=978-1-4503-2029-0
, s2cid=447011
]
[
{{cite journal
, last1=Xu , first1=Zhiqiang
, year=2018
, title=The minimal measurement number for low-rank matrix recovery
, journal=]Applied and Computational Harmonic Analysis
''Applied and Computational Harmonic Analysis'' is a bimonthly peer-reviewed scientific journal published by Elsevier. The journal covers studies on the applied and computational aspects of harmonic analysis. Its editors-in-chief are Ronald Coifma ...
, volume=44 , issue=2 , pages=497–508
, arxiv=1505.07204
, doi=10.1016/j.acha.2017.01.005
, s2cid=11990443
[
{{cite journal
, last1=Nguyen , first1=L.T.
, last2=Kim , first2=J.
, last3=Kim , first3=S.
, last4=Shim , first4=B.
, year=2019
, title=Localization of IoT Networks Via Low-Rank Matrix Completion
, journal= IEEE Transactions on Communications
, volume=67
, issue=8
, pages=5833–5847
, doi=10.1109/TCOMM.2019.2915226
, s2cid=164605437
]
[
{{cite journal
, last1=Mahindre , first1=G.
, last2=Jayasumana , first2=A.P.
, last3=Gajamannage , first3=K.
, last4=Paffenroth , first4=R.
, year=2019
, title=On sampling and recovery of topology of directed social networks–a low-rank matrix completion based approach
, journal= IEEE Conference on Local Computer Networks
, publisher=IEEE
, pages=324–331
, doi=10.1109/LCN44214.2019.8990707
, isbn=978-1-7281-1028-8
, s2cid=211206354
]
Matrix theory