paper-with-me

홈 › Papers

Characterization of the probability and information entropy of a process with an increasing sample space by different functional forms of expansion, with an application to hyperinflation

2021-05-27 · Laurence Francis Lacey

There is a random variable (X) with a determined outcome (i.e., X = x0), p(x0) = 1. Consider x0 to have a discrete uniform distribution over the integer interval [1, s], where the size of the sample space (s) = 1, in the initial state, such that p(x0) = 1. What is the probability of x0 and the associated information entropy (H), as s increases by means of different functional forms of expansion? Such a process has been characterised in the case of (1) a mono-exponential expansion of the sample space; (2) a power function expansion; (3) double exponential expansion. The double exponential expansion of the sample space with time (from a natural log relationship between t and n) describes a "hyperinflationary" process. Over the period from the middle of 1920 to the end of 1923, the purchasing power of the Weimar Republic paper Mark to purchase one gold Mark became close to zero (1 paper Mark = 10 to the power of -12 gold Mark). From the purchasing power of the paper Mark to purchase one gold Mark, the information entropy of this hyperinflationary process was determined.

📄 PDF Abstract BibTeX arXiv:2107.05483

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Characterization of the probability and information entropy of a process with an exponentially increasing sample space and its application to the Broad Money Supply

2021-05-14 · Laurence F Lacey

There is a random variable (X) with a determined outcome (i.e., X = x0), p(x0) = 1. Consider x0 to have a discrete uniform distribution over the integer interval [1, s], where the size of the sample space (s) = 1, in the…

Variational Characterizations of Local Entropy and Heat Regularization in Deep Learning

2019-01-29 · Nicolas Garcia Trillos, Zach Kaplan, Daniel Sanz-Alonso

The aim of this paper is to provide new theoretical and computational understanding on two loss regularizations employed in deep learning, known as local entropy and heat regularization. For both regularized losses we in…

Applications of Entropy in Data Analysis and Machine Learning: A Review

2025-03-04 · Salomé A. Sepúveda Fontaine, José M. Amigó

Since its origin in the thermodynamics of the 19th century, the concept of entropy has also permeated other fields of physics and mathematics, such as Classical and Quantum Statistical Mechanics, Information Theory, Prob…

Synthesis and Analysis of Data as Probability Measures with Entropy-Regularized Optimal Transport

2025-01-13 · Brendan Mallery, James M. Murphy, Shuchin Aeron

We consider synthesis and analysis of probability measures using the entropy-regularized Wasserstein-2 cost and its unbiased version, the Sinkhorn divergence. The synthesis problem consists of computing the barycenter, w…

Functional Properties of the Focal-Entropy

2026-03-03 · Jaimin Shah, Martina Cardone, Alex Dytso arxiv

The focal-loss has become a widely used alternative to cross-entropy in class-imbalanced classification problems, particularly in computer vision. Despite its empirical success, a systematic information-theoretic study o…