paper-with-me

Papers

Superposition as Data Augmentation using LSTM and HMM in Small Training Sets

2019-10-24 · Akilesh Sivaswamy, Evgeny Pavlovskiy

Considering audio and image data as having quantum nature (data are represented by density matrices), we achieved better results on training architectures such as 3-layer stacked LSTM and HMM by mixing training samples using superposition augmentation and compared with plain default training and mix-up augmentation. This augmentation technique originates from the mix-up approach but provides more solid theoretical reasoning based on quantum properties. We achieved 3% improvement (from 68% to 71%) by using 38% lesser number of training samples in Russian audio-digits recognition task and 7,16% better accuracy than mix-up augmentation by training only 500 samples using HMM on the same task. Also, we achieved 1.1% better accuracy than mix-up on first 900 samples in MNIST using 3-layer stacked LSTM.

📄 PDF Abstract BibTeX arXiv:1910.10881

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

LSTM-TDNN with convolutional front-end for Dialect Identification in the 2019 Multi-Genre Broadcast Challenge

2019-12-19 · Xiaoxiao Miao, Ian McLoughlin

This paper presents a novel Dialect Identification (DID) system developed for the Fifth Edition of the Multi-Genre Broadcast challenge, the task of Fine-grained Arabic Dialect Identification (MGB-5 ADI Challenge). The sy…

Data AugmentationDialect Identification

SINAI-DL at SemEval-2019 Task 5: Recurrent networks and data augmentation by paraphrasing

2019-06-01 · SEMEVAL 2019 6 · Arturo Montejo-R{\'a}ez, Salud Mar{\'\i}a Jim{\'e}nez-Zafra, Miguel A. Garc{\'\i}a-Cumbreras, Manuel Carlos D{\'\i}az-Galiano

This paper describes the participation of the SINAI-DL team at Task 5 in SemEval 2019, called HatEval. We have applied some classic neural network layers, like word embeddings and LSTM, to build a neural classifier for b…

Data AugmentationWord Embeddings

Augmenting Small Data to Classify Contextualized Dialogue Acts for Exploratory Visualization

2020-05-01 · LREC 2020 5 · Abhinav Kumar, Barbara Di Eugenio, Jillian Aurisano, Andrew Johnson

Our goal is to develop an intelligent assistant to support users explore data via visualizations. We have collected a new corpus of conversations, CHICAGO-CRIME-VIS, geared towards supporting data visualization explorati…

Data AugmentationData VisualizationDialogue Act ClassificationWord Embeddings

AirMixML: Over-the-Air Data Mixup for Inherently Privacy-Preserving Edge Machine Learning

2021-05-02 · Yusuke Koda, Jihong Park, Mehdi Bennis, Praneeth Vepakomma 외

Wireless channels can be inherently privacy-preserving by distorting the received signals due to channel noise, and superpositioning multiple signals over-the-air. By harnessing these natural distortions and superpositio…

BIG-bench Machine LearningData AugmentationPrivacy Preserving

Superposition unifies power-law training dynamics

2026-02-01 · Zixin Jessie Chen, Hao Chen, Yizhou Liu, Jeff Gore arxiv

We investigate the role of feature superposition in the emergence of power-law training dynamics using a teacher-student framework. We first derive an analytic theory for training without superposition, establishing that…