Information Theory

Information theory is the scientific study of the quantification, storage, and communication of information. The field was fundamentally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s. The field is at the intersection of probability theory, statistics, computer science, statistical mechanics, information engineering, and electrical engineering. A key measure in information theory is entropy. Entropy quantifies the amount of uncertainty involved in the value of a random variable or the outcome of a random process. For example, identifying the outcome of a fair coin flip (with two equally likely outcomes) …

Wikipedia

Publications

EU: European Union · 22 April 2024 English

Based on a literature review incorporating papers written before July 2021, this report presents behavioural factors affecting peoples’ decision to invest in socially responsible investment (SRI) products. It groups behavioural …

findings are consistent with “affect- as-information” theory (Schwarz and Clore, 2003), since investors


PIK: Potsdam-Institut fur Klimafolgenforschung · 11 April 2024 English

While it is widely assumed that poor countries will suffer more from climate change, and that climate change will exacerbate inequalities within countries, systematic and large-scale evidence on this issue …

40% [46]. The Theil index [47] derives from information theory, and offers interesting decom- position properties 42 87–153 [47] Theil H 1967 Economics and Information Theory vol 7 (North-Holland) [48] Berrang-Ford L


ERC: European Research Council · 8 April 2024 English

ERC Advanced Grants 2023 List of Principal Investigators – PE domain Host institution refers to institution at time of application Host Institution local Host Last name First name Host Institution …

University of Cambridge UK SCLIT PE7 Cambridge in Information Theory The SMBH mass factory - University of University


NBER: National Bureau of Economic Research · 1 March 2024 English

Using friendship data from Facebook, we study the effects of three aspects of social capital on household financial behavior. We find that the most important measure of social capital in …

Network structure and the aggregation of information: Theory and evidence from indonesia, American Economic


PIK: Potsdam-Institut fur Klimafolgenforschung · 28 February 2024 English

Correlation does not necessarily imply causation, and this is why causal methods have been developed to try to disentangle true causal links from spurious relationships. In our study, we use …

e., for- mulated from first principles of information theory (Liang, 2016). Under the assumption of a


NBER: National Bureau of Economic Research · 16 February 2024 English

We propose a framework where perceptions of uncertainty are driven by the interaction between cognitive constraints and the way that people learn about it—whether information is presented sequentially or simultaneously. …

bounded rationality—efficient coding and information theory. The salience of some component (in our case rationality, namely efficient coding and information theory. The salience of some component (in our case


RAND Corporation · 29 January 2024 English

This is the first in a series of four papers examining how Command and Control (C2) will manifest in the future. This first paper sets a baseline for the subsequent …

fields such as mathematics, graph theory, information theory, chaos theory, systems theory, computational


NCAER: National Council of Applied Economic Research · 20 January 2024 English

Email: sdesai@ncaer.org Disclaimer: The findings, interpretations, and conclusions expressed in the paper are those of the authors and do not necessarily reflect the views of the Governing Body or Management …

Network structure and the aggregation of information: Theory and evidence from Indonesia. American Economic


NBER: National Bureau of Economic Research · 18 January 2024 English

Concentration is a single summary statistic driven by two opposing forces: the number of firms in a market and the evenness of their market shares. This paper introduces a generalized …

this measure was originally developed in information theory (Shannon, 1948), it was first proposed in


NBER: National Bureau of Economic Research · 18 January 2024 English

We survey aspects of the intellectual development of the economics of information from the 1970s to today. We focus here on models where information is communicated indirectly through actions. Basic …

ideas are related to, but different from “information theory” where the focus is on the information transmitted


View more