paper-with-me

홈 › Papers

Generalized and Unified Equivalences between Hardness and Pseudoentropy

2025-07-08 · Lunjia Hu, Salil Vadhan arxiv

Pseudoentropy characterizations provide a quantitatively precise demonstration of the close relationship between computational hardness and computational randomness. We prove a unified pseudoentropy characterization that generalizes and strengthens previous results for both uniform and non-uniform models of computation. Our characterization holds for a general family of entropy notions that encompasses the common notions of Shannon entropy and min entropy as special cases. Moreover, we show that the characterizations for different entropy notions can be simultaneously achieved by a single, universal function that simultaneously witnesses computational hardness and computational randomness. A key technical insight of our work is that the notion of weight-restricted calibration from the recent literature on algorithm fairness, along with standard computational indistinguishability (known as multiaccuracy in the fairness literature), suffices for proving pseudoentropy characterizations for general entropy notions. This demonstrates the power of weight-restricted calibration to enhance the classic Complexity-Theoretic Regularity Lemma (Trevisan, Tulsiani, and Vadhan, 2009) and Leakage Simulation Lemma (Jetchev and Pietrzak, 2014) and allows us to achieve an exponential improvement in the complexity dependency on the alphabet size compared to the pseudoentropy characterizations by Casacuberta, Dwork, and Vadhan (2024) based on the much stronger notion of multicalibration. We show that the exponential dependency on the alphabet size is inevitable for multicalibration as well as for the weaker notion of calibrated multiaccuracy.

📄 PDF Abstract BibTeX arXiv:2507.05972

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generalized equivalences between subsampling and ridge regularization

2023-05-29 · NeurIPS 2023 11

We establish precise structural and risk equivalences between subsampling and ridge regularization for ensemble ridge estimators. Specifically, we prove that linear and quadratic functionals of subsample ridge estimators…

regression

Conspiracies between Learning Algorithms, Circuit Lower Bounds and Pseudorandomness

2016-11-03 · Igor C. Oliveira, Rahul Santhanam

We prove several results giving new and stronger connections between learning, circuit lower bounds and pseudorandomness. Among other results, we show a generic learning speedup lemma, equivalences between various learni…

LEMMA

On the Strong Equivalences of LPMLN Programs

2019-09-18 · Bin Wang, Jun Shen, Shutao Zhang, Zhizheng Zhang

By incorporating the methods of Answer Set Programming (ASP) and Markov Logic Networks (MLN), LPMLN becomes a powerful tool for non-monotonic, inconsistent and uncertain knowledge representation and reasoning. To facilit…

Gaussian Processes and Reproducing Kernels: Connections and Equivalences

2025-06-20 · Motonobu Kanagawa, Philipp Hennig, Dino Sejdinovic, Bharath K. Sriperumbudur

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). T…

Gaussian ProcessesNumerical Integration

Generalized Splines and Gaussian Processes

2026-08-28 · Michael Unser arxiv

For finite-dimensional linear inverse problems where the variables are Gaussian, it is well-known that the minimum-mean-square error estimator takes the form of a regularized least-squares data fit. In this chapter, we s…

Gaussian Processes