Optimal Layer Selection for Latent Data Augmentation
While data augmentation (DA) is generally applied to input data, several studies have reported that applying DA to hidden layers in neural networks, i.e., feature augmentation, can improve performance. However, in previous studies, the layers to which DA is applied have not been carefully considered, often being applied randomly and uniformly or only to a specific layer, leaving room for arbitrariness. Thus, in this study, we investigated the trends of suitable layers for applying DA in various experimental configurations, e.g., training from scratch, transfer learning, various dataset settings, and different models. In addition, to adjust the suitable layers for DA automatically, we propose the adaptive layer selection (AdaLASE) method, which updates the ratio to perform DA for each layer based on the gradient descent method during training. The experimental results obtained on several image classification datasets indicate that the proposed AdaLASE method altered the ratio as expected and achieved high overall test accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Data Augmentationimage-classificationImage ClassificationOverall - TestTransfer LearningSimilar Papers 제목 키워드 기반
LatentAugment: Dynamically Optimized Latent Probabilities of Data Augmentation
Although data augmentation is a powerful technique for improving the performance of image classification tasks, it is difficult to identify the best augmentation policy. The optimal augmentation policy, which is the late…
Data Augmentationimage-classificationImage ClassificationTheoretical Guarantees of Data Augmented Last Layer Retraining Methods
Ensuring fair predictions across many distinct subpopulations in the training data can be prohibitive for large models. Recently, simple linear last layer retraining strategies, in combination with data augmentation meth…
Data AugmentationCADA-GAN: Context-Aware GAN with Data Augmentation
Current child face generators are restricted by the limited size of the available datasets. In addition, feature selection can prove to be a significant challenge, especially due to the large amount of features that need…
Data Augmentationfeature selectionFair In-Context Learning via Latent Concept Variables
The emerging in-context learning (ICL) ability of large language models (LLMs) has prompted their use for predictive tasks in various domains with different types of data facilitated by serialization methods. However, wi…
Data AugmentationFairnessIn-Context LearningSensor Selection in High-Dimensional Gaussian Trees with Nuisances
We consider the sensor selection problem on multivariate Gaussian distributions where only a \emph{subset} of latent variables is of inferential interest. For pairs of vertices connected by a unique path in the graph, w…
validVocal Bursts Intensity Prediction