paper-with-me

홈 › Papers

Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problem

2022-02-18 · Abderrahmen Amich, Birhanu Eshete

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and investigate the causes behind ML models' susceptibility to adversarial examples. In particular, we focus on exploring the cause-effect link between adversarial examples and the out-of-distribution (OOD) problem. To that end, we propose an OOD generalization method that stands against both adversary-induced and natural distribution shifts. Through an OOD to in-distribution mapping intuition, our approach translates OOD inputs to the data distribution used to train and test the model. Through extensive experiments on three benchmark image datasets of different scales (MNIST, CIFAR10, and ImageNet) and by leveraging image-to-image translation methods, we confirm that the adversarial examples problem is a special case of the wider OOD generalization problem. Across all datasets, we show that our translation-based approach consistently improves robustness to OOD adversarial inputs and outperforms state-of-the-art defenses by a significant margin, while preserving the exact accuracy on benign (in-distribution) data. Furthermore, our method generalizes on naturally OOD inputs such as darker or sharper images

📄 PDF Abstract BibTeX arXiv:2202.08944

Code (1)

ood2iid/code 공식 구현 pytorch

Tasks

BIG-bench Machine LearningImage-to-Image TranslationTranslation

Similar Papers 제목 키워드 기반

Rethinking Robustness in Machine Learning: A Posterior Agreement Approach

2025-03-20 · João Borges S. Carvalho, Alessandro Torcinovich, Victor Jimenez Rodriguez, Antonio E. Cinà 외

The robustness of algorithms against covariate shifts is a fundamental problem with critical implications for the deployment of machine learning algorithms in the real world. Current evaluation methods predominantly matc…

Domain Generalization

Distributional Robustness with IPMs and links to Regularization and GANs

2020-06-08 · NeurIPS 2020 12 · Hisham Husain

Robustness to adversarial attacks is an important concern due to the fragility of deep neural networks to small perturbations and has received an abundance of attention in recent years. Distributionally Robust Optimizati…

Rethinking AI-Generated Text Detection: A Strong Baseline and the Distribution-Shift Problem That Remains

2026-07-04 · Zhuoer Shen, Mingyi Wang, Shaofeng Zou, Yuheng Bu arxiv

Recent AI-generated text detection work often introduces a new benchmark together with a specialized detector tailored to it. We revisit this practice from a baseline-first perspective. Across several benchmarks, we show…

Domain AdaptationText Detection

Out-of-distribution Neural Inference in Dynamical Ising Models

2026-07-03 · Yuan-Bin Zhu, Shuang Qiao, Shi-Ju Ran arxiv

Neural networks are increasingly used to infer hidden physical structure from dynamical observations, yet it remains unclear whether their out-of-distribution performance reflects transferable physical rule learning. We …

Rethinking Distributional Matching Based Domain Adaptation

2020-06-23 · Bo Li, Yezhen Wang, Tong Che, Shanghang Zhang 외

Domain adaptation (DA) is a technique that transfers predictive models trained on a labeled source domain to an unlabeled target domain, with the core difficulty of resolving distributional shift between domains. Current…

Domain Adaptation