paper-with-me

Papers

StackSeq2Seq: Dual Encoder Seq2Seq Recurrent Networks

2017-10-11 · Alessandro Bay, Biswa Sengupta

A widely studied non-deterministic polynomial time (NP) hard problem lies in finding a route between the two nodes of a graph. Often meta-heuristics algorithms such as $A^{*}$ are employed on graphs with a large number of nodes. Here, we propose a deep recurrent neural network architecture based on the Sequence-2-Sequence (Seq2Seq) model, widely used, for instance in text translation. Particularly, we illustrate that utilising a context vector that has been learned from two different recurrent networks enables increased accuracies in learning the shortest route of a graph. Additionally, we show that one can boost the performance of the Seq2Seq network by smoothing the loss function using a homotopy continuation of the decoder's loss function.

📄 PDF Abstract BibTeX arXiv:1710.04211

Code (0)

등록된 구현이 없습니다.

Tasks

Translation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Video Ladder Networks

2016-12-06 · Francesco Cricri, Xingyang Ni, Mikko Honkala, Emre Aksu 외

We present the Video Ladder Network (VLN) for efficiently generating future video frames. VLN is a neural encoder-decoder model augmented at all layers by both recurrent and feedforward lateral connections. At each layer…

Decoder

Denoising Auto-encoder with Recurrent Skip Connections and Residual Regression for Music Source Separation

2018-07-05 · Jen-Yu Liu, Yi-Hsuan Yang

Convolutional neural networks with skip connections have shown good performance in music source separation. In this work, we propose a denoising Auto-encoder with Recurrent skip Connections (ARC). We use 1D convolution a…

ARCDenoisingMusic Source Separationregression

Residual Recurrent CRNN for End-to-End Optical Music Recognition on Monophonic Scores

2020-10-26 · Aozhi Liu, Lipei Zhang, Yaqi Mei, Baoqiang Han 외

One of the challenges of the Optical Music Recognition task is to transcript the symbols of the camera-captured images into digital music notations. Previous end-to-end model which was developed as a Convolutional Recurr…

Decoder

ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition

2022-09-29 · Martin Radfar, Rohit Barnwal, Rupak Vignesh Swaminathan, Feng-Ju Chang 외

The recurrent neural network transducer (RNN-T) is a prominent streaming end-to-end (E2E) ASR technology. In RNN-T, the acoustic encoder commonly consists of stacks of LSTMs. Very recently, as an alternative to LSTM laye…

speech-recognitionSpeech Recognition

Sync-DRAW: Automatic Video Generation using Deep Recurrent Attentive Architectures

2016-11-30 · Gaurav Mittal, Tanya Marwah, Vineeth N. Balasubramanian

This paper introduces a novel approach for generating videos called Synchronized Deep Recurrent Attentive Writer (Sync-DRAW). Sync-DRAW can also perform text-to-video generation which, to the best of our knowledge, makes…

Text-to-Video GenerationVideo Generation