paper-with-me

Papers

FACESEC: A Fine-grained Robustness Evaluation Framework for Face Recognition Systems

2021-04-08 · CVPR 2021 1 · Liang Tong, Zhengzhang Chen, Jingchao Ni, Wei Cheng, Dongjin Song, Haifeng Chen, Yevgeniy Vorobeychik

We present FACESEC, a framework for fine-grained robustness evaluation of face recognition systems. FACESEC evaluation is performed along four dimensions of adversarial modeling: the nature of perturbation (e.g., pixel-level or face accessories), the attacker's system knowledge (about training data and learning architecture), goals (dodging or impersonation), and capability (tailored to individual inputs or across sets of these). We use FACESEC to study five face recognition systems in both closed-set and open-set settings, and to evaluate the state-of-the-art approach for defending against physically realizable attacks on these. We find that accurate knowledge of neural architecture is significantly more important than knowledge of the training data in black-box attacks. Moreover, we observe that open-set face recognition systems are more vulnerable than closed-set systems under different types of attacks. The efficacy of attacks for other threat model variations, however, appears highly dependent on both the nature of perturbation and the neural network architecture. For example, attacks that involve adversarial face masks are usually more potent, even against adversarially trained models, and the ArcFace architecture tends to be more robust than the others.

📄 PDF Abstract BibTeX arXiv:2104.04107

Code (1)

KnowledgeDiscovery/FaceSec 공식 구현 pytorch

Tasks

Face Recognition

Methods 이 논문이 사용한 방법론

ArcFace ArcFace, or Additive Angular Margin Loss, is a loss function used in face recognition tasks. The softmax is traditionally used…

Similar Papers 제목 키워드 기반

Fine-Grained Benchmark Generation for Comprehensive Evaluation of Foundation Models

2026-05-12 · Mohammed Saidul Islam, Negin Baghbanzadeh, Farnaz Kohankhaki, Afshin Cheraghi 외 arxiv

Evaluation of foundation models often rely on aggregate scores from benchmarks that lack comprehensive coverage and metadata for a fine-grained evaluation. We introduce a framework for automated benchmark generation. Our…

Revisiting the robustness of post-hoc interpretability methods

2024-07-29 · Jiawen Wei, Hugues Turbé, Gianmarco Mengaldo

Post-hoc interpretability methods play a critical role in explainable artificial intelligence (XAI), as they pinpoint portions of data that a trained deep learning model deemed important to make a decision. However, diff…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

AttackEval: How to Evaluate the Effectiveness of Jailbreak Attacking on Large Language Models

2024-01-17 · Dong Shu, Mingyu Jin, Chong Zhang, Liangyao Li 외

Ensuring the security of large language models (LLMs) against attacks has become increasingly urgent, with jailbreak attacks representing one of the most sophisticated threats. To deal with such risks, we introduce an in…

System Report for CCL25-Eval Task 10: Prompt-Driven Large Language Model Merge for Fine-Grained Chinese Hate Speech Detection

2025-12-10 · Binglin Wu, Jiaxiu Zou, Xianneng Li arxiv

The proliferation of hate speech on Chinese social media poses urgent societal risks, yet traditional systems struggle to decode context-dependent rhetorical strategies and evolving slang. To bridge this gap, we propose …

Hate Speech DetectionPrompt EngineeringDomain Adaptation

FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question Answering

2024-04-29 · Wei Zhou, Mohsen Mesgar, Heike Adel, Annemarie Friedrich

Table Question Answering (TQA) aims at composing an answer to a question based on tabular data. While prior research has shown that TQA models lack robustness, understanding the underlying cause and nature of this issue …

Question Answering