paper-with-me

Papers

Confidence-Calibrated Adversarial Training: Generalizing to Unseen Attacks

2019-10-14 · ICML 2020 1 · David Stutz, Matthias Hein, Bernt Schiele

Adversarial training yields robust models against a specific threat model, e.g., $L_\infty$ adversarial examples. Typically robustness does not generalize to previously unseen threat models, e.g., other $L_p$ norms, or larger perturbations. Our confidence-calibrated adversarial training (CCAT) tackles this problem by biasing the model towards low confidence predictions on adversarial examples. By allowing to reject examples with low confidence, robustness generalizes beyond the threat model employed during training. CCAT, trained only on $L_\infty$ adversarial examples, increases robustness against larger $L_\infty$, $L_2$, $L_1$ and $L_0$ attacks, adversarial frames, distal adversarial examples and corrupted examples and yields better clean accuracy compared to adversarial training. For thorough evaluation we developed novel white- and black-box attacks directly attacking CCAT by maximizing confidence. For each threat model, we use $7$ attacks with up to $50$ restarts and $5000$ iterations and report worst-case robust test error, extended to our confidence-thresholded setting, across all attacks.

📄 PDF Abstract BibTeX arXiv:1910.06259

Code (3)

davidstutz/icml2020-confidence-calibrated-adversarial-training 공식 구현
davidstutz/confidence-calibrated-adversarial-training pytorch
val-iisc/flss pytorch

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Confidence-Calibrated Adversarial Training: Towards Robust Models Generalizing Beyond the Attack Used During Training

2019-09-25 · David Stutz, Matthias Hein, Bernt Schiele

Adversarial training is the standard to train models robust against adversarial examples. However, especially for complex datasets, adversarial training incurs a significant loss in accuracy and is known to generalize po…

Calibrated Domain-Invariant Learning for Highly Generalizable Large Scale Re-Identification

2019-11-26 · Ye Yuan, Wuyang Chen, Tianlong Chen, Yang Yang 외

Many real-world applications, such as city-scale traffic monitoring and control, requires large-scale re-identification. However, previous ReID methods often failed to address two limitations in existing ReID benchmarks,…

Teaching Models to Express Their Uncertainty in Words

2022-05-28 · Stephanie Lin, Jacob Hilton, Owain Evans

We show that a GPT-3 model can learn to express uncertainty about its own answers in natural language -- without use of model logits. When given a question, the model generates both an answer and a level of confidence (e…

Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning

2023-11-08 · Muhammad Akhtar Munir, Muhammad Haris Khan, M. Saquib Sarfraz, Mohsen Ali

Deep learning based object detectors struggle generalizing to a new target domain bearing significant variations in object and background. Most current methods align domains by using image or instance-level adversarial f…

Objectobject-detectionObject Detection

Toward Metrics for Differentiating Out-of-Distribution Sets

2019-10-18 · Mahdieh Abbasi, Changjian Shui, Arezoo Rajabi, Christian Gagne 외

Vanilla CNNs, as uncalibrated classifiers, suffer from classifying out-of-distribution (OOD) samples nearly as confidently as in-distribution samples. To tackle this challenge, some recent works have demonstrated the gai…

image-classificationImage ClassificationOut of Distribution (OOD) Detection