paper-with-me

Papers

Recurrent autoencoder with sequence-aware encoding

2020-09-15 · Robert Susik

Recurrent Neural Networks (RNN) received a vast amount of attention last decade. Recently, the architectures of Recurrent AutoEncoders (RAE) found many applications in practice. RAE can extract the semantically valuable information, called context that represents a latent space useful for further processing. Nevertheless, recurrent autoencoders are hard to train, and the training process takes much time. In this paper, we propose an autoencoder architecture with sequence-aware encoding, which employs 1D convolutional layer to improve its performance in terms of model training time. We prove that the recurrent autoencoder with sequence-aware encoding outperforms a standard RAE in terms of training speed in most cases. The preliminary results show that the proposed solution dominates over the standard RAE, and the training process is order of magnitude faster.

📄 PDF Abstract BibTeX arXiv:2009.07349

Code (1)

rsusik/raesc 공식 구현 tf

Methods 이 논문이 사용한 방법론

RAE This method introduces several regularization schemes that can be applied to an Autoencoder. To make the model generative *ex-post* density estimation is proposed and consists in…
Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Encoding-based Memory Modules for Recurrent Neural Networks

2020-01-31 · Antonio Carta, Alessandro Sperduti, Davide Bacciu

Learning to solve sequential tasks with recurrent models requires the ability to memorize long sequences and to extract task-relevant features from them. In this paper, we study the memorization subtask from the point of…

Memorization

Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks

2016-11-02 · NeurIPS 2016 12 · Hao Wang, Xingjian Shi, Dit-yan Yeung

Hybrid methods that utilize both content and rating information are commonly used in many recommender systems. However, most of them use either handcrafted features or the bag-of-words representation as a surrogate for t…

Collaborative FilteringDenoisingRecommendation Systems

ClefNet: Recurrent Autoencoders with Dynamic Time Warping for Near-Lossless Music Compression and Minimal-Latency Transmission

2021-03-15 · Vignav Ramesh, Mason Wang

The onset of coronavirus disease 2019 (COVID-19), an infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has sparked unprecedented change. Due to the public health guidelines impose…

Audio CompressionDynamic Time WarpingMusic Compression

Context- and Sequence-Aware Convolutional Recurrent Encoder for Neural Machine Translation

2021-01-11 · Ritam Mallick, Seba Susan, Vaibhaw Agrawal, Rizul Garg 외

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the…

DecoderMachine TranslationSentenceTranslation

Autoencoder-based Initialization for Recurrent Neural Networks with a Linear Memory

2019-09-25 · Antonio Carta, Alessandro Sperduti, Davide Bacciu

Orthogonal recurrent neural networks address the vanishing gradient problem by parameterizing the recurrent connections using an orthogonal matrix. This class of models is particularly effective to solve tasks that requi…

MemorizationPermuted-MNIST