paper-with-me

홈 › Papers

MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection

2026-08-18 · Xiaoyong Yu, Rongzhen Li, Shuming Shi, Xinge You arxiv

Facial biometric recognition systems currently face compound threats intertwining generative AI and high-fidelity physical spoofing. Existing defenses suffer from systemic bottlenecks, including poor generalization, non-auditable reasoning, and reliance on massive, low-quality datasets. To address these challenges, we propose Multimodal Large Language Models (MFAD) for face anti-spoofing detection, an explainable reasoning system for Unified Face Anti-Spoofing Detection (UFAD), accompanied by a semantic-level annotation benchmark. Unlike methods relying on external tools or coarse alignment, MFAD activates the intrinsic reasoning capabilities of Multimodal Large Language Models (MLLMs) via a fine-grained pixel-semantic anchoring mechanism. This eliminates localization hallucinations and ensures auditable reasoning paths. We introduce a cross-attack semantic-level unified annotation paradigm: by annotating only 1,000 precise masks per attack category, we generate reasoning evidence chains strictly corresponding to spoofed regions. Supervised fine-tuning on the Qwen-VL foundation model demonstrates that, using limited high-quality samples, the system achieves a 40-50% relative reduction in in-domain ACER and restricts cross-domain performance degradation to within 11.62%/5.23%, significantly outperforming existing frameworks. Furthermore, under white-box adversarial attacks, detection accuracy drops by only 3.2%, validating the robustness of semantic anchoring compared to models trained on massive short-text data. Domain practitioners rated the evidence reliability of reasoning paths at 4.57/5, with inference latency satisfying real-time deployment requirements. These results confirm that a few-shot, high-quality semantic annotation paradigm is effective for building trustworthy, explainable, and cost-efficient UFAD systems.

📄 PDF Abstract BibTeX arXiv:2608.17328

Code (0)

등록된 구현이 없습니다.

Tasks

Face Anti-Spoofing

Similar Papers 제목 키워드 기반

Representation Space Constrained Learning with Modality Decoupling for Multimodal Object Detection

2025-11-19 · YiKang Shao, Tao Shi arxiv

Multimodal object detection has attracted significant attention in both academia and industry for its enhanced robustness. Although numerous studies have focused on improving modality fusion strategies, most neglect fusi…

Object Detection

Beyond the Benchmark: Detecting Diverse Anomalies in Videos

2023-10-03 · Yoav Arad, Michael Werman

Video Anomaly Detection (VAD) plays a crucial role in modern surveillance systems, aiming to identify various anomalies in real-world situations. However, current benchmark datasets predominantly emphasize simple, single…

Action RecognitionAnomaly DetectionDensity EstimationNovel Object Detection+4

X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

2023-05-07 · Feilong Chen, Minglun Han, Haozhi Zhao, Qingyang Zhang 외

Large language models (LLMs) have demonstrated remarkable language abilities. GPT-4, based on advanced LLMs, exhibits extraordinary multimodal capabilities beyond previous visual language models. We attribute this to the…

AttributeInstruction FollowingLanguage ModellingLarge Language Model+2

ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models

2023-06-16 · Jackie Junrui Yang, Yingtian Shi, Yuhan Zhang, Karina Li 외

By combining voice and touch interactions, multimodal interfaces can surpass the efficiency of either modality alone. Traditional multimodal frameworks require laborious developer work to support rich multimodal commands…

SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models

2024-02-06 · Yichen Shi, Yuhao Gao, Yingxin Lai, Hongyang Wang 외

Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-related tasks, capitalizing on their visual semantic comprehension and reasoning capabilities. However, their ability to detect sub…

AttributeFace Anti-SpoofingMultiple-choiceObject Recognition