paper-with-me

홈 › Papers

Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attacks

2023-09-24 · NeurIPS 2023 11 · Ao-Xiang Zhang, Yu Ran, Weixuan Tang, Yuan-Gen Wang

No-Reference Video Quality Assessment (NR-VQA) plays an essential role in improving the viewing experience of end-users. Driven by deep learning, recent NR-VQA models based on Convolutional Neural Networks (CNNs) and Transformers have achieved outstanding performance. To build a reliable and practical assessment system, it is of great necessity to evaluate their robustness. However, such issue has received little attention in the academic community. In this paper, we make the first attempt to evaluate the robustness of NR-VQA models against adversarial attacks, and propose a patch-based random search method for black-box attack. Specifically, considering both the attack effect on quality score and the visual quality of adversarial video, the attack problem is formulated as misleading the estimated quality score under the constraint of just-noticeable difference (JND). Built upon such formulation, a novel loss function called Score-Reversed Boundary Loss is designed to push the adversarial video's estimated quality score far away from its ground-truth score towards a specific boundary, and the JND constraint is modeled as a strict $L_2$ and $L_\infty$ norm restriction. By this means, both white-box and black-box attacks can be launched in an effective and imperceptible manner. The source code is available at https://github.com/GZHU-DVL/AttackVQA.

📄 PDF Abstract BibTeX arXiv:2309.13609

Code (1)

gzhu-dvl/attackvqa 공식 구현 pytorch

Tasks

Video Quality AssessmentVisual Question Answering (VQA)

Methods 이 논문이 사용한 방법론

Random Search Random Search replaces the exhaustive enumeration of all combinations by selecting them randomly. This can be simply applied to the discrete setting described above, but also…

Similar Papers 제목 키워드 기반

Cross-Modal Transferable Image-to-Video Attack on Video Quality Metrics

2025-01-14 · Georgii Gotin, Ekaterina Shumitskaya, Anastasia Antsiferova, Dmitriy Vatolin

Recent studies have revealed that modern image and video quality assessment (IQA/VQA) metrics are vulnerable to adversarial attacks. An attacker can manipulate a video through preprocessing to artificially increase its q…

Video Quality AssessmentVisual Question Answering (VQA)

Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation

2025-07-16 · Sahid Hossain Mustakim, S M Jishanul Islam, Ummay Maria Muna, Montasir Chowdhury 외

Multimodal Large Language Models (MLLMs) are increasingly used for content moderation, yet their robustness in short-form video contexts remains underexplored. Current safety evaluations often rely on unimodal attacks, f…

Adversarial Purification and Fine-tuning for Robust UDC Image Restoration

2024-02-21 · Zhenbo Song, Zhenyuan Zhang, Kaihao Zhang, Zhaoxin Fan 외

This study delves into the enhancement of Under-Display Camera (UDC) image restoration models, focusing on their robustness against adversarial attacks. Despite its innovative approach to seamless display integration, UD…

Adversarial PurificationImage Restoration

AIS 2024 Challenge on Video Quality Assessment of User-Generated Content: Methods and Results

2024-04-24 · Marcos V. Conde, Saman Zadtootaghaj, Nabajeet Barman, Radu Timofte 외

This paper reviews the AIS 2024 Video Quality Assessment (VQA) Challenge, focused on User-Generated Content (UGC). The aim of this challenge is to gather deep learning-based methods capable of estimating the perceptual q…

Video Quality AssessmentVisual Question Answering (VQA)

Secure Video Quality Assessment Resisting Adversarial Attacks

2024-10-09 · Ao-Xiang Zhang, Yu Ran, Weixuan Tang, Yuan-Gen Wang 외

The exponential surge in video traffic has intensified the imperative for Video Quality Assessment (VQA). Leveraging cutting-edge architectures, current VQA models have achieved human-comparable accuracy. However, recent…

Adversarial DefenseVideo Quality AssessmentVisual Question Answering (VQA)