paper-with-me

홈 › Papers

Further advantages of data augmentation on convolutional neural networks

2019-06-26 · Alex Hernández-García, Peter König

Data augmentation is a popular technique largely used to enhance the training of convolutional neural networks. Although many of its benefits are well known by deep learning researchers and practitioners, its implicit regularization effects, as compared to popular explicit regularization techniques, such as weight decay and dropout, remain largely unstudied. As a matter of fact, convolutional neural networks for image object classification are typically trained with both data augmentation and explicit regularization, assuming the benefits of all techniques are complementary. In this paper, we systematically analyze these techniques through ablation studies of different network architectures trained with different amounts of training data. Our results unveil a largely ignored advantage of data augmentation: networks trained with just data augmentation more easily adapt to different architectures and amount of training data, as opposed to weight decay and dropout, which require specific fine-tuning of their hyperparameters.

📄 PDF Abstract BibTeX arXiv:1906.11052

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

Handwritten Amharic Character Recognition Using a Convolutional Neural Network

2019-09-23 · Mesay Samuel Gondere, Lars Schmidt-Thieme, Abiot Sinamo Boltena, Hadi Samer Jomaa

Amharic is the official language of the Federal Democratic Republic of Ethiopia. There are lots of historic Amharic and Ethiopic handwritten documents addressing various relevant issues including governance, science, rel…

Data AugmentationMulti-Task Learning

Leveraging SO(3)-steerable convolutions for pose-robust semantic segmentation in 3D medical data

2023-03-01 · Ivan Diaz, Mario Geiger, Richard Iain McKinley

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further …

Data AugmentationMedical Image AnalysisSegmentationSemantic Segmentation

An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks

2020-07-31 · Brian Kenji Iwana, Seiichi Uchida

In recent times, deep artificial neural networks have achieved many successes in pattern recognition. Part of this success can be attributed to the reliance on big data to increase generalization. However, in the field o…

Data AugmentationGeneral ClassificationSurveyTime Series+2

Diagnosing Cardiac Abnormalities from 12-Lead Electrocardiograms Using Enhanced Deep Convolutional Neural Networks

2019-08-15 · Binhang Yuan, Wenhui Xing

We train an enhanced deep convolutional neural network in order to identify eight cardiac abnormalities from the standard 12-lead electrocardiograms (ECGs) using the dataset of 14000 ECGs. Instead of straightforwardly ap…

Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification

2016-08-15 · IEEE Signal Processing Letters 2017 1 · Justin Salamon, Juan Pablo Bello

The ability of deep convolutional neural networks (CNN) to learn discriminative spectro-temporal patterns makes them well suited to environmental sound classification. However, the relative scarcity of labeled data has i…

Data AugmentationDictionary LearningEnvironmental Sound ClassificationGeneral Classification+1