paper-with-me

홈 › Papers

Multimodal Attack Detection for Action Recognition Models

2024-04-13 · Furkan Mumcu, Yasin Yilmaz

Adversarial machine learning attacks on video action recognition models is a growing research area and many effective attacks were introduced in recent years. These attacks show that action recognition models can be breached in many ways. Hence using these models in practice raises significant security concerns. However, there are very few works which focus on defending against or detecting attacks. In this work, we propose a novel universal detection method which is compatible with any action recognition model. In our extensive experiments, we show that our method consistently detects various attacks against different target models with high true positive rates while satisfying very low false positive rates. Tested against four state-of-the-art attacks targeting four action recognition models, the proposed detector achieves an average AUC of 0.911 over 16 test cases while the best performance achieved by the existing detectors is 0.645 average AUC. This 41.2% improvement is enabled by the robustness of the proposed detector to varying attack methods and target models. The lowest AUC achieved by our detector across the 16 test cases is 0.837 while the competing detector's performance drops as low as 0.211. We also show that the proposed detector is robust to varying attack strengths. In addition, we analyze our method's real-time performance with different hardware setups to demonstrate its potential as a practical defense mechanism.

📄 PDF Abstract BibTeX arXiv:2404.10790

Code (1)

furkanmumcu/vlad 공식 구현 pytorch

Tasks

Action RecognitionTemporal Action Localization

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

MADPromptS: Unlocking Zero-Shot Morphing Attack Detection with Multiple Prompt Aggregation

2025-08-12 · Eduarda Caldeira, Fadi Boutros, Naser Damer arxiv

Face Morphing Attack Detection (MAD) is a critical challenge in face recognition security, where attackers can fool systems by interpolating the identity information of two or more individuals into a single face image, r…

Prompt EngineeringFace Recognition

Can audio-visual integration strengthen robustness under multimodal attacks?

2021-04-05 · CVPR 2021 1 · Yapeng Tian, Chenliang Xu

In this paper, we propose to make a systematic study on machines multisensory perception under attacks. We use the audio-visual event recognition task against multimodal adversarial attacks as a proxy to investigate the …

audio-visual learningVisual Localization

BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluation

2024-11-17 · Haiyang Yu, Tian Xie, Jiaping Gui, Pengyang Wang 외

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed…

Action Recognitionbackdoor defenseData PoisoningDiversity+5

Learning Knowledge-based Prompts for Robust 3D Mask Presentation Attack Detection

2025-05-06 · Fangling Jiang, Qi Li, Bing Liu, Weining Wang 외

3D mask presentation attack detection is crucial for protecting face recognition systems against the rising threat of 3D mask attacks. While most existing methods utilize multimodal features or remote photoplethysmograph…

Face RecognitionKnowledge GraphsPrompt Learning

Hyperbolic Face Anti-Spoofing

2023-08-17 · Shuangpeng Han, Rizhao Cai, Yawen Cui, Zitong Yu 외

Learning generalized face anti-spoofing (FAS) models against presentation attacks is essential for the security of face recognition systems. Previous FAS methods usually encourage models to extract discriminative feature…

Contrastive LearningFace Anti-SpoofingFace Recognition