paper-with-me

홈 › Papers

Tractable and Near-Optimal Adversarial Algorithms for Robust Estimation in Contaminated Gaussian Models

2021-12-24 · Ziyue Wang, Zhiqiang Tan

Consider the problem of simultaneous estimation of location and variance matrix under Huber's contaminated Gaussian model. First, we study minimum $f$-divergence estimation at the population level, corresponding to a generative adversarial method with a nonparametric discriminator and establish conditions on $f$-divergences which lead to robust estimation, similarly to robustness of minimum distance estimation. More importantly, we develop tractable adversarial algorithms with simple spline discriminators, which can be implemented via nested optimization such that the discriminator parameters can be fully updated by maximizing a concave objective function given the current generator. The proposed methods are shown to achieve minimax optimal rates or near-optimal rates depending on the $f$-divergence and the penalty used. This is the first time such near-optimal error rates are established for adversarial algorithms with linear discriminators under Huber's contamination model. We present simulation studies to demonstrate advantages of the proposed methods over classic robust estimators, pairwise methods, and a generative adversarial method with neural network discriminators.

📄 PDF Abstract BibTeX arXiv:2112.12919

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Robust W-GAN-Based Estimation Under Wasserstein Contamination

2021-01-20 · Zheng Liu, Po-Ling Loh

Robust estimation is an important problem in statistics which aims at providing a reasonable estimator when the data-generating distribution lies within an appropriately defined ball around an uncontaminated distribution…

regression

An Optimal Transport Approach for Computing Adversarial Training Lower Bounds in Multiclass Classification

2024-01-17 · Nicolas Garcia Trillos, Matt Jacobs, Jakwang Kim, Matthew Werenski

Despite the success of deep learning-based algorithms, it is widely known that neural networks may fail to be robust. A popular paradigm to enforce robustness is adversarial training (AT), however, this introduces many c…

Tractable Gaussian Phase Retrieval with Heavy Tails and Adversarial Corruption with Near-Linear Sample Complexity

2026-01-26 · Santanu Das, Jatin Batra arxiv

Phase retrieval is the classical problem of recovering a signal $x^* \in \mathbb{R}^n$ from its noisy phaseless measurements $y_i = \langle a_i, x^* \rangle^2 + ζ_i$ (where $ζ_i$ denotes noise, and $a_i$ is the sensing v…

Robustness Implies Privacy in Statistical Estimation

2022-12-09 · Samuel B. Hopkins, Gautam Kamath, Mahbod Majid, Shyam Narayanan

We study the relationship between adversarial robustness and differential privacy in high-dimensional algorithmic statistics. We give the first black-box reduction from privacy to robustness which can produce private est…

Adversarial Robustnessparameter estimation

Novel Upper Bounds for the Constrained Most Probable Explanation Task

2021-12-01 · NeurIPS 2021 12 · Tahrima Rahman, Sara Rouhani, Vibhav Gogate

We propose several schemes for upper bounding the optimal value of the constrained most probable explanation (CMPE) problem. Given a set of discrete random variables, two probabilistic graphical models defined over them…