paper-with-me

홈 › Papers

CADDA: Class-wise Automatic Differentiable Data Augmentation for EEG Signals

2021-06-25 · ICLR 2022 4 · Cédric Rommel, Thomas Moreau, Joseph Paillard, Alexandre Gramfort

Data augmentation is a key element of deep learning pipelines, as it informs the network during training about transformations of the input data that keep the label unchanged. Manually finding adequate augmentation methods and parameters for a given pipeline is however rapidly cumbersome. In particular, while intuition can guide this decision for images, the design and choice of augmentation policies remains unclear for more complex types of data, such as neuroscience signals. Besides, class-dependent augmentation strategies have been surprisingly unexplored in the literature, although it is quite intuitive: changing the color of a car image does not change the object class to be predicted, but doing the same to the picture of an orange does. This paper investigates gradient-based automatic data augmentation algorithms amenable to class-wise policies with exponentially larger search spaces. Motivated by supervised learning applications using EEG signals for which good augmentation policies are mostly unknown, we propose a new differentiable relaxation of the problem. In the class-agnostic setting, results show that our new relaxation leads to optimal performance with faster training than competing gradient-based methods, while also outperforming gradient-free methods in the class-wise setting. This work proposes also novel differentiable augmentation operations relevant for sleep stage classification.

📄 PDF Abstract BibTeX arXiv:2106.13695

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationEEGElectroencephalogram (EEG)

Similar Papers 제목 키워드 기반

Learning Layer-wise Equivariances Automatically using Gradients

2023-09-21 · NeurIPS 2023 11

Convolutions encode equivariance symmetries into neural networks leading to better generalisation performance. However, symmetries provide fixed hard constraints on the functions a network can represent, need to be speci…

Differentiable Ranking and Sorting using Optimal Transport

2019-12-01 · NeurIPS 2019 12 · Marco Cuturi, Olivier Teboul, Jean-Philippe Vert

Sorting is used pervasively in machine learning, either to define elementary algorithms, such as $k$-nearest neighbors ($k$-NN) rules, or to define test-time metrics, such as top-$k$ classification accuracy or ranking lo…

quantile regression

Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis

2024-06-07 · Chin-Yun Yu, György Fazekas

Training the linear prediction (LP) operator end-to-end for audio synthesis in modern deep learning frameworks is slow due to its recursive formulation. In addition, frame-wise approximation as an acceleration method can…

Audio Synthesis

Layer- and Timestep-Adaptive Differentiable Token Compression Ratios for Efficient Diffusion Transformers

2024-12-22 · CVPR 2025 1 · Haoran You, Connelly Barnes, Yuqian Zhou, Yan Kang 외

Diffusion Transformers (DiTs) have achieved state-of-the-art (SOTA) image generation quality but suffer from high latency and memory inefficiency, making them difficult to deploy on resource-constrained devices. One majo…

DenoisingImage Generation

Learning second-order TVD flux limiters using differentiable solvers

2025-03-11 · Chenyang Huang, Amal S. Sebastian, Venkatasubramanian Viswanathan

This paper presents a data-driven framework for learning optimal second-order total variation diminishing (TVD) flux limiters via differentiable simulations. In our fully differentiable finite volume solvers, the limiter…