paper-with-me

Papers

Robustmix: Improving Robustness by Regularizing the Frequency Bias of Deep Nets

2023-04-06 · Jonas Ngnawe, Marianne ABEMGNIGNI NJIFON, Jonathan Heek, Yann Dauphin

Deep networks have achieved impressive results on a range of well-curated benchmark datasets. Surprisingly, their performance remains sensitive to perturbations that have little effect on human performance. In this work, we propose a novel extension of Mixup called Robustmix that regularizes networks to classify based on lower-frequency spatial features. We show that this type of regularization improves robustness on a range of benchmarks such as Imagenet-C and Stylized Imagenet. It adds little computational overhead and, furthermore, does not require a priori knowledge of a large set of image transformations. We find that this approach further complements recent advances in model architecture and data augmentation, attaining a state-of-the-art mCE of 44.8 with an EfficientNet-B8 model and RandAugment, which is a reduction of 16 mCE compared to the baseline.

📄 PDF Abstract BibTeX arXiv:2304.02847

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

RandAugment 설명 없음
Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

WaveCNet: Wavelet Integrated CNNs to Suppress Aliasing Effect for Noise-Robust Image Classification

2021-07-28 · Qiufu Li, Linlin Shen, Sheng Guo, Zhihui Lai

Though widely used in image classification, convolutional neural networks (CNNs) are prone to noise interruptions, i.e. the CNN output can be drastically changed by small image noise. To improve the noise robustness, we …

Adversarial Robustnessimage-classificationImage Classification

UnbiasedNets: A Dataset Diversification Framework for Robustness Bias Alleviation in Neural Networks

2023-02-24 · Mahum Naseer, Bharath Srinivas Prabakaran, Osman Hasan, Muhammad Shafique

Performance of trained neural network (NN) models, in terms of testing accuracy, has improved remarkably over the past several years, especially with the advent of deep learning. However, even the most accurate NNs can b…

Wavelet Integrated CNNs for Noise-Robust Image Classification

2020-05-07 · CVPR 2020 6 · Qiufu Li, Linlin Shen, Sheng Guo, Zhihui Lai

Convolutional Neural Networks (CNNs) are generally prone to noise interruptions, i.e., small image noise can cause drastic changes in the output. To suppress the noise effect to the final predication, we enhance CNNs by …

ClassificationGeneral Classificationimage-classificationImage Classification

Efficient ConvNets for Analog Arrays

2018-07-03 · Malte J. Rasch, Tayfun Gokmen, Mattia Rigotti, Wilfried Haensch

Analog arrays are a promising upcoming hardware technology with the potential to drastically speed up deep learning. Their main advantage is that they compute matrix-vector products in constant time, irrespective of the …

IB-U-Nets: Improving medical image segmentation tasks with 3D Inductive Biased kernels

2022-10-28 · Shrajan Bhandary, Zahra Babaiee, Dejan Kostyszyn, Tobias Fechter 외

Despite the success of convolutional neural networks for 3D medical-image segmentation, the architectures currently used are still not robust enough to the protocols of different scanners, and the variety of image proper…

Image SegmentationInductive BiasMedical Image AnalysisMedical Image Segmentation+1