paper-with-me

홈 › Papers

Towards Adversarially Robust Deep Metric Learning

2025-01-02 · Xiaopeng Ke

Deep Metric Learning (DML) has shown remarkable successes in many domains by taking advantage of powerful deep neural networks. Deep neural networks are prone to adversarial attacks and could be easily fooled by adversarial examples. The current progress on this robustness issue is mainly about deep classification models but pays little attention to DML models. Existing works fail to thoroughly inspect the robustness of DML and neglect an important DML scenario, the clustering-based inference. In this work, we first point out the robustness issue of DML models in clustering-based inference scenarios. We find that, for the clustering-based inference, existing defenses designed DML are unable to be reused and the adaptions of defenses designed for deep classification models cannot achieve satisfactory robustness performance. To alleviate the hazard of adversarial examples, we propose a new defense, the Ensemble Adversarial Training (EAT), which exploits ensemble learning and adversarial training. EAT promotes the diversity of the ensemble, encouraging each model in the ensemble to have different robustness features, and employs a self-transferring mechanism to make full use of the robustness statistics of the whole ensemble in the update of every single model. We evaluate the EAT method on three widely-used datasets with two popular model architectures. The results show that the proposed EAT method greatly outperforms the adaptions of defenses designed for deep classification models.

📄 PDF Abstract BibTeX arXiv:2501.01025

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringEnsemble LearningMetric Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks

2023-11-01 · Yichen Huang, Timothy Baldwin

We investigate MT evaluation metric performance on adversarially-synthesized texts, to shed light on metric robustness. We experiment with word- and character-level attacks on three popular machine translation metrics: B…

Machine TranslationSentenceTranslation

A Spectral View of Adversarially Robust Features

2018-11-15 · NeurIPS 2018 12 · Shivam Garg, Vatsal Sharan, Brian Hu Zhang, Gregory Valiant

Given the apparent difficulty of learning models that are robust to adversarial perturbations, we propose tackling the simpler problem of developing adversarially robust features. Specifically, given a dataset and metric…

Adversarially Robust CLIP Models Can Induce Better (Robust) Perceptual Metrics

2025-02-17 · Francesco Croce, Christian Schlarmann, Naman Deep Singh, Matthias Hein

Measuring perceptual similarity is a key tool in computer vision. In recent years perceptual metrics based on features extracted from neural networks with large and diverse training sets, e.g. CLIP, have become popular. …

Image Retrieval

On the Hardness of Robustness Transfer: A Perspective from Rademacher Complexity over Symmetric Difference Hypothesis Space

2023-02-23 · Yuyang Deng, Nidham Gazagnadou, Junyuan Hong, Mehrdad Mahdavi 외

Recent studies demonstrated that the adversarially robust learning under $\ell_\infty$ attack is harder to generalize to different domains than standard domain adaptation. How to transfer robustness across different doma…

Binary ClassificationDomain AdaptationDomain GeneralizationFederated Learning

Adversarially Perturbed Wavelet-based Morphed Face Generation

2021-11-03 · Kelsey O'Haire, Sobhan Soleymani, Baaria Chaudhary, Poorya Aghdaie 외

Morphing is the process of combining two or more subjects in an image in order to create a new identity which contains features of both individuals. Morphed images can fool Facial Recognition Systems (FRS) into falsely a…

Face GenerationImage GenerationMORPH