paper-with-me

Papers

Frequency-Based Vulnerability Analysis of Deep Learning Models against Image Corruptions

2023-06-12 · Harshitha Machiraju, Michael H. Herzog, Pascal Frossard

Deep learning models often face challenges when handling real-world image corruptions. In response, researchers have developed image corruption datasets to evaluate the performance of deep neural networks in handling such corruptions. However, these datasets have a significant limitation: they do not account for all corruptions encountered in real-life scenarios. To address this gap, we present MUFIA (Multiplicative Filter Attack), an algorithm designed to identify the specific types of corruptions that can cause models to fail. Our algorithm identifies the combination of image frequency components that render a model susceptible to misclassification while preserving the semantic similarity to the original image. We find that even state-of-the-art models trained to be robust against known common corruptions struggle against the low visibility-based corruptions crafted by MUFIA. This highlights the need for more comprehensive approaches to enhance model robustness against a wider range of real-world image corruptions.

📄 PDF Abstract BibTeX arXiv:2306.07178

Code (1)

code-assasin/mufiacode 공식 구현 pytorch

Tasks

ClassificationRobust classification

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

Fourier Analysis on Robustness of Graph Convolutional Neural Networks for Skeleton-based Action Recognition

2023-05-29 · Nariki Tanaka, Hiroshi Kera, Kazuhiko Kawamoto

Using Fourier analysis, we explore the robustness and vulnerability of graph convolutional neural networks (GCNs) for skeleton-based action recognition. We adopt a joint Fourier transform (JFT), a combination of the grap…

Action Recognitionimage-classificationImage ClassificationSkeleton Based Action Recognition

Exploiting Frequency Spectrum of Adversarial Images for General Robustness

2023-05-15 · Chun Yang Tan, Kazuhiko Kawamoto, Hiroshi Kera

In recent years, there has been growing concern over the vulnerability of convolutional neural networks (CNNs) to image perturbations. However, achieving general robustness against different types of perturbations remain…

Data Augmentation

Analysing the Robustness of Vision-Language-Models to Common Corruptions

2025-04-18 · Muhammad Usama, Syeda Aishah Asim, Syed Bilal Ali, Syed Talal Wasim 외

Vision-language models (VLMs) have demonstrated impressive capabilities in understanding and reasoning about visual and textual content. However, their robustness to common image corruptions remains under-explored. In th…

TextVQA

PVF (Parameter Vulnerability Factor): A Scalable Metric for Understanding AI Vulnerability Against SDCs in Model Parameters

2024-05-02 · Xun Jiao, Fred Lin, Harish D. Dixit, Joel Coburn 외

Reliability of AI systems is a fundamental concern for the successful deployment and widespread adoption of AI technologies. Unfortunately, the escalating complexity and heterogeneity of AI hardware systems make them inc…

text-classificationText Classification

Improving robustness against common corruptions with frequency biased models

2021-03-30 · ICCV 2021 10 · Tonmoy Saikia, Cordelia Schmid, Thomas Brox

CNNs perform remarkably well when the training and test distributions are i.i.d, but unseen image corruptions can cause a surprisingly large drop in performance. In various real scenarios, unexpected distortions, such as…

Data Augmentationobject-detectionObject Detection