paper-with-me

홈 › Papers

Conditionally Strongly Log-Concave Generative Models

2023-05-31 · Florentin Guth, Etienne Lempereur, Joan Bruna, Stéphane Mallat

There is a growing gap between the impressive results of deep image generative models and classical algorithms that offer theoretical guarantees. The former suffer from mode collapse or memorization issues, limiting their application to scientific data. The latter require restrictive assumptions such as log-concavity to escape the curse of dimensionality. We partially bridge this gap by introducing conditionally strongly log-concave (CSLC) models, which factorize the data distribution into a product of conditional probability distributions that are strongly log-concave. This factorization is obtained with orthogonal projectors adapted to the data distribution. It leads to efficient parameter estimation and sampling algorithms, with theoretical guarantees, although the data distribution is not globally log-concave. We show that several challenging multiscale processes are conditionally log-concave using wavelet packet orthogonal projectors. Numerical results are shown for physical fields such as the $\varphi^4$ model and weak lensing convergence maps with higher resolution than in previous works.

📄 PDF Abstract BibTeX arXiv:2306.00181

Code (1)

elempereur/wcrg 공식 구현 pytorch

Tasks

Memorizationparameter estimation

Similar Papers 제목 키워드 기반

Exponential Convergence of Gradient Methods in Concave Network Zero-sum Games

2020-07-10 · Amit Kadan, Hu Fu

Motivated by Generative Adversarial Networks, we study the computation of Nash equilibrium in concave network zero-sum games (NZSGs), a multiplayer generalization of two-player zero-sum games first proposed with linear p…

Tester-Learners for Halfspaces: Universal Algorithms

2023-05-19 · NeurIPS 2023 11

We give the first tester-learner for halfspaces that succeeds universally over a wide class of structured distributions. Our universal tester-learner runs in fully polynomial time and has the following guarantee: the lea…

A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problems

2020-06-03 · Zi Xu, Huiling Zhang, Yang Xu, Guanghui Lan

Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent appli…

First-order Convergence Theory for Weakly-Convex-Weakly-Concave Min-max Problems

2018-10-24 · Mingrui Liu, Hassan Rafique, Qihang Lin, Tianbao Yang

In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimiza…

Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency

2021-02-25 · Yuyang Deng, Mehrdad Mahdavi

Local SGD is a promising approach to overcome the communication overhead in distributed learning by reducing the synchronization frequency among worker nodes. Despite the recent theoretical advances of local SGD in empir…