Information Theory
Information theory is the scientific study of the quantification, storage, and communication of information. The field was fundamentally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s. The field is at the intersection of probability theory, statistics, computer science, statistical mechanics, information engineering, and electrical engineering. A key measure in information theory is entropy. Entropy quantifies the amount of uncertainty involved in the value of a random variable or the outcome of a random process. For example, identifying the outcome of a fair coin flip (with two equally likely outcomes) …
WikipediaPublications
NBER: National Bureau of Economic Research · 1 November 2024 English
We argue that deep learning provides a promising avenue for taming the curse of dimensionality in quantitative economics. We begin by exploring the unique challenges posed by solving dynamic equilibrium …
sig- moidal function,” IEEE Transactions on Information Theory, 39, 930–945. Belkin, M. (2024): “The puzzle …
NBER: National Bureau of Economic Research · 17 October 2024 English
Information spillovers between firms can reduce R&D incentives if competitors can free ride on innovations. However, strong property rights may impede cumulative research and lead to inefficient duplication. These effects …
0.48. This reects the classic result in information theory (see for example MacKay, 2003) that the information …
ALIA: Australian Library and Information Association · 11 October 2024 English
The Australian Library and Information Association (ALIA), the Council of Australian University Librarians (CAUL) and National and State Libraries Australasia (NSLA) are collaborating with the Indigenous Archives and Data Stewardship …
librarianship? Encyclopedia of library and information theory, and research sciences (3rd ed.). Boca Raton …
IMF: International Monetary Fund · 4 October 2024 English
Soft power is difficult to measure directly, and existing indicators—mostly subjective and not always transparent—fail to take into account the multidimensional nature of soft power. In this paper, we introduce …
Quantization in PCM," IEEE Transactions on Information Theory, Vol. 28, pp. 129–137. MacQueen, J. (1967) …
NBER: National Bureau of Economic Research · 4 October 2024 English
Portfolio optimization focuses on risk and return prediction, yet implementation costs critically matter. Predicting trading costs is challenging because costs depend on trade size and trader identity, thus impeding a …
Transactions on Information Theory 51:2664–9. Conference Name: IEEE Transactions on Information Theory. Benston …
NBER: National Bureau of Economic Research · 3 October 2024 English
We introduce DOSE—Dynamically Optimized Sequential Experimentation—to elicit preference parameters. DOSE starts with a model of preferences and a prior over the parameters of that model, then dynamically chooses a customized …
its conceptual simplicity and grounding in information theory (see Ryan et al., 2016, for a discussion …
Social Europe · 17 September 2024 English
So, if you wish to ponder about European sovereignty and/or break through the united front of EU and EU member states with regard to sovereignty – understood as legislative capability …
well-established. From as far back as articles on information theory in the 1970s we know that so-called asymmetric …
LSE: London School of Economics and Political Science · 13 September 2024 English
In Making Information Matter, Mareile Kaufmann proposes a methodology for studying information practices as a living process, developing her argument through four case studies. Employing a theoretical framework that includes …
NBER: National Bureau of Economic Research · 5 September 2024 English
Empirical research typically involves a robustness-efficiency tradeoff. A researcher seeking to estimate a scalar parameter can invoke strong assumptions to motivate a restricted estimator that is precise but may be …
infeasible. References Akaike, H. (1973). Information theory and an extension of the maximum likelihood … In Proc. 2nd International Symposium on Information Theory, 1973, pp. 267–281. Akademiai Kiado. Angrist …
NBER: National Bureau of Economic Research · 5 September 2024 English
While the trade literature has tended to view export activity and innovation as complementary activities, we present evidence that financial constraints are a reason the two activities can act as …
and Credit Constraints under Incomplete Information: Theory and Evidence from China”, Review of Economics …