paper-with-me

홈 › Papers

A Fourier Perspective on Model Robustness in Computer Vision

2019-06-21 · NeurIPS 2019 12 · Dong Yin, Raphael Gontijo Lopes, Jonathon Shlens, Ekin D. Cubuk, Justin Gilmer

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across corruption types. Indeed increasing performance in the presence of random noise is often met with reduced performance on other corruptions such as contrast change. Understanding when and why these sorts of trade-offs occur is a crucial step towards mitigating them. Towards this end, we investigate recently observed trade-offs caused by Gaussian data augmentation and adversarial training. We find that both methods improve robustness to corruptions that are concentrated in the high frequency domain while reducing robustness to corruptions that are concentrated in the low frequency domain. This suggests that one way to mitigate these trade-offs via data augmentation is to use a more diverse set of augmentations. Towards this end we observe that AutoAugment, a recently proposed data augmentation policy optimized for clean accuracy, achieves state-of-the-art robustness on the CIFAR-10-C benchmark.

📄 PDF Abstract BibTeX arXiv:1906.08988

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
AutoAugment 설명 없음

Similar Papers 제목 키워드 기반

Fourier Sensitivity and Regularization of Computer Vision Models

2023-01-31 · Kiran Krishnamachari, See-Kiong Ng, Chuan-Sheng Foo

Recent work has empirically shown that deep neural networks latch on to the Fourier statistics of training data and show increased sensitivity to Fourier-basis directions in the input. Understanding and modifying this Fo…

Sensitivity

Deep Fractional Fourier Transform

2023-09-21 · NeurIPS 2023 11

Existing deep learning-based computer vision methods usually operate in the spatial and frequency domains, which are two orthogonal \textbf{individual} perspectives for image processing. In this paper, we introduce a new…

Fourier-basis Functions to Bridge Augmentation Gap: Rethinking Frequency Augmentation in Image Classification

2024-03-04 · CVPR 2024 1 · Puru Vaish, Shunxin Wang, Nicola Strisciuglio

Computer vision models normally witness degraded performance when deployed in real-world scenarios, due to unexpected changes in inputs that were not accounted for during training. Data augmentation is commonly used to a…

Data Augmentationimage-classificationImage Classification

Fourier-Based Augmentations for Improved Robustness and Uncertainty Calibration

2022-02-24 · Ryan Soklaski, Michael Yee, Theodoros Tsiligkaridis

Diverse data augmentation strategies are a natural approach to improving robustness in computer vision models against unforeseen shifts in data distribution. However, the ability to tailor such strategies to inoculate a …

Data AugmentationImage Augmentation

Scaling Up Computer Vision Neural Networks Using Fast Fourier Transform

2023-02-02 · Siddharth Agrawal

Deep Learning-based Computer Vision field has recently been trying to explore larger kernels for convolution to effectively scale up Convolutional Neural Networks. Simultaneously, new paradigm of models such as Vision Tr…