Constraint in
information theory
Information theory is the mathematical study of the quantification (science), quantification, Data storage, storage, and telecommunications, communication of information. The field was established and formalized by Claude Shannon in the 1940s, ...
is the degree of statistical dependence between or among variables.
Garner
[ Garner W R (1962). ''Uncertainty and Structure as Psychological Concepts'', John Wiley & Sons, New York.] provides a thorough discussion of various forms of constraint (internal constraint, external constraint, total constraint) with application to
pattern recognition
Pattern recognition is the task of assigning a class to an observation based on patterns extracted from data. While similar, pattern recognition (PR) is not to be confused with pattern machines (PM) which may possess PR capabilities but their p ...
and
psychology
Psychology is the scientific study of mind and behavior. Its subject matter includes the behavior of humans and nonhumans, both consciousness, conscious and Unconscious mind, unconscious phenomena, and mental processes such as thoughts, feel ...
.
See also
*
Mutual Information
*
Total Correlation
*
Interaction information
References
Information theory
{{compsci-stub