paper-with-me

홈 › Papers

Outlier-Robust Wasserstein DRO

2023-09-21 · NeurIPS 2023 11

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to~sampling or localized perturbations of data points is captured by Wasserstein DRO (WDRO), which seeks to learn a model that performs uniformly well over a Wasserstein ball centered around the observed data distribution. However, WDRO fails to account for non-geometric perturbations such as adversarial outliers, which can greatly distort the Wasserstein distance measurement and impede the learned model. We address this gap by proposing a novel outlier-robust WDRO framework for decision-making under both geometric (Wasserstein) perturbations and non-geometric (total variation (TV)) contamination that allows an $\varepsilon$-fraction of data to be arbitrarily corrupted. We design an uncertainty set using a certain robust Wasserstein ball that accounts for both perturbation types and derive minimax optimal excess risk bounds for this procedure that explicitly capture the Wasserstein and TV risks. We prove a strong duality result that enables tractable convex reformulations and efficient computation of our outlier-robust WDRO problem. When the loss function depends only on low-dimensional features of the data, we eliminate certain dimension dependencies from the risk bounds that are unavoidable in the general setting. Finally, we present experiments validating our theory on standard regression and classification tasks.Submission Number: 14144

📄 PDF Abstract BibTeX

Code (1)

sbnietert/outlier-robust-wdro 공식 구현

Similar Papers 제목 키워드 기반

Approximate Algorithms For $k$-Sparse Wasserstein Barycenter With Outliers

2024-04-20 · Qingyuan Yang, Hu Ding

Wasserstein Barycenter (WB) is one of the most fundamental optimization problems in optimal transportation. Given a set of distributions, the goal of WB is to find a new distribution that minimizes the average Wasserstei…

Clustering

Probabilistic Outlier Detection and Generation

2020-12-22 · Stefano Giovanni Rizzo, Linsey Pang, Yixian Chen, Sanjay Chawla

A new method for outlier detection and generation is introduced by lifting data into the space of probability distributions which are not analytically expressible, but from which samples can be drawn using a neural gener…

Outlier Detection

Hierarchical Gaussian Processes with Wasserstein-2 Kernels

2020-10-28 · Sebastian Popescu, David Sharp, James Cole, Ben Glocker

Stacking Gaussian Processes severely diminishes the model's ability to detect outliers, which when combined with non-zero mean functions, further extrapolates low non-parametric variance to low training data density regi…

Gaussian ProcessesOut-of-Distribution Detection

When OT meets MoM: Robust estimation of Wasserstein Distance

2020-06-18 · Guillaume Staerman, Pierre Laforgue, Pavlo Mozharovskyi, Florence d'Alché-Buc

Issued from Optimal Transport, the Wasserstein distance has gained importance in Machine Learning due to its appealing geometrical properties and the increasing availability of efficient approximations. In this work, we …

Generative Adversarial Network

A New Robust Partial $p$-Wasserstein-Based Metric for Comparing Distributions

2024-05-06 · Sharath Raghvendra, Pouyan Shirzadian, Kaiyi Zhang

The $2$-Wasserstein distance is sensitive to minor geometric differences between distributions, making it a very powerful dissimilarity metric. However, due to this sensitivity, a small outlier mass can also cause a sign…

Image RetrievalSensitivity