information theory Information theory is the mathematical study of the quantification (science), quantification, Data storage, storage, and telecommunications, communication of information. The field was established and formalized by Claude Shannon in the 1940s, ...

, specific-information is the generic name given to the family of state-dependent measures that in expectation converge to the

mutual information In probability theory and information theory, the mutual information (MI) of two random variables is a measure of the mutual Statistical dependence, dependence between the two variables. More specifically, it quantifies the "Information conten ...

. There are currently three known varieties of specific information usually denoted

I_V

I_S

, and

I_

. The specific-information between a

random variable A random variable (also called random quantity, aleatory variable, or stochastic variable) is a Mathematics, mathematical formalization of a quantity or object which depends on randomness, random events. The term 'random variable' in its mathema ...

X

and a state

Y=y

is written as :

I( X ; Y = y)

References

* *{{cite journal , pages=177–87 , doi=10.1088/0954-898X/14/2/301 , title=How much information is associated with a particular stimulus? , year=2003 , last1=Butts , first1=Daniel , journal=Network: Computation in Neural Systems , volume=14 , issue=2 , pmid=12790180 Information theory