Information theory is the mathematical study of the quantification, storage, and communication of information. The field was established and put on a...

In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential...

complexity theory, algorithmic information theory, and information-theoretic security. Applications of fundamental topics of information theory include source...

Integrated information theory (IIT) proposes a mathematical model for the consciousness of a system. It comprises a framework ultimately intended to explain...

The receiver in information theory is the receiving end of a communication channel. It receives decoded messages/information from the sender, who first...

information theory (AIT) is a branch of theoretical computer science that concerns itself with the relationship between computation and information of...

subsequent leaks. Beyond applications to programming language, information flow control theories have been applied to operating systems, distributed systems...

In information theory, redundancy measures the fractional difference between the entropy H(X) of an ensemble X, and its maximum possible value log ⁡ (...

Organizational Information Theory (OIT) is a communication theory, developed by Karl Weick, offering systemic insight into the processing and exchange...

Quantum information is the information of the state of a quantum system. It is the basic entity of study in quantum information theory, and can be manipulated...

Information processing theory is the approach to the study of cognitive development evolved out of the American experimental tradition in psychology....

Structural information theory (SIT) is a theory about human perception and in particular about visual perceptual organization, which is a neuro-cognitive...

discusses how information theory (a branch of mathematics studying the transmission, processing and storage of information) is related to measure theory (a branch...

similar to the information entropy by Claude Shannon and Ralph Hartley, developed in the 1940s. The defining expression for entropy in the theory of statistical...

Information field theory (IFT) is a Bayesian statistical field theory relating to signal reconstruction, cosmography, and other related areas. IFT summarizes...

on Information Theory is a monthly peer-reviewed scientific journal published by the IEEE Information Theory Society. It covers information theory and...

This is a list of information theory topics. A Mathematical Theory of Communication algorithmic information theory arithmetic coding channel capacity Communication...

might be thought of as gambling theory applied to the world around us. The myriad applications for logarithmic information measures tell us precisely how...

cryptographer and inventor known as the "father of information theory" and as the "father of the Information Age". Shannon was the first to describe the Boolean...

Social information processing theory, also known as SIP, is a psychological and sociological theory originally developed by Salancik and Pfeffer in 1978...

The Information: A History, a Theory, a Flood is a book by science history writer James Gleick, published in March 2011, which covers the genesis of the...

In probability theory and information theory, the mutual information (MI) of two random variables is a measure of the mutual dependence between the two...

information theory, and brought it to immediate worldwide attention, was the publication of Claude E. Shannon's classic paper "A Mathematical Theory of...

intelligence theory — Progressive education theory Engineering: Circuit theory — Control theory — Signal theory — Systems theory — Information theory Film: Film...

A timeline of events related to  information theory,  quantum information theory and statistical physics,  data compression,  error correcting codes and...

In coding theory and information theory, a Z-channel or binary asymmetric channel is a communications channel used to model the behaviour of some data...

Media richness theory (MRT), sometimes referred to as information richness theory, is a framework used to describe a communication medium's ability to...

Inequalities are very important in the study of information theory. There are a number of different contexts in which these inequalities appear. Consider...

or the expected value of the observed information. The role of the Fisher information in the asymptotic theory of maximum-likelihood estimation was emphasized...

In information theory, the information content, self-information, surprisal, or Shannon information is a basic quantity derived from the probability of...