paper-with-me

Papers

Parallel Long Short-Term Memory for Multi-stream Classification

2017-02-11 · Mohamed Bouaziz, Mohamed Morchid, Richard Dufour, Georges Linarès, Renato de Mori

Recently, machine learning methods have provided a broad spectrum of original and efficient algorithms based on Deep Neural Networks (DNN) to automatically predict an outcome with respect to a sequence of inputs. Recurrent hidden cells allow these DNN-based models to manage long-term dependencies such as Recurrent Neural Networks (RNN) and Long Short-Term Memory (LSTM). Nevertheless, these RNNs process a single input stream in one (LSTM) or two (Bidirectional LSTM) directions. But most of the information available nowadays is from multistreams or multimedia documents, and require RNNs to process these information synchronously during the training. This paper presents an original LSTM-based architecture, named Parallel LSTM (PLSTM), that carries out multiple parallel synchronized input sequences in order to predict a common output. The proposed PLSTM method could be used for parallel sequence classification purposes. The PLSTM approach is evaluated on an automatic telecast genre sequences classification task and compared with different state-of-the-art architectures. Results show that the proposed PLSTM method outperforms the baseline n-gram models as well as the state-of-the-art LSTM approach.

📄 PDF Abstract BibTeX arXiv:1702.03402

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classification

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Parallelizable Stack Long Short-Term Memory

2019-04-06 · WS 2019 6 · Shuoyang Ding, Philipp Koehn

Stack Long Short-Term Memory (StackLSTM) is useful for various applications such as parsing and string-to-tree neural machine translation, but it is also known to be notoriously difficult to parallelize for GPU training …

GPUMachine TranslationTranslation

Research on Data Fusion Algorithm Based on Deep Learning in Target Tracking

2022-11-23 · Huihui Wu

Aiming at the limitation that deep long and short-term memory network(DLSTM) algorithm cannot perform parallel computing and cannot obtain global information, in this paper, feature extraction and feature processing are …

xLSTM: Extended Long Short-Term Memory

2024-05-07 · Maximilian Beck, Korbinian Pöppel, Markus Spanring, Andreas Auer 외

In the 1990s, the constant error carousel and gating were introduced as the central ideas of the Long Short-Term Memory (LSTM). Since then, LSTMs have stood the test of time and contributed to numerous deep learning succ…

Language ModelingLanguage ModellingState Space Models

Single stream parallelization of generalized LSTM-like RNNs on a GPU

2015-03-10 · Kyuyeon Hwang, Wonyong Sung

Recurrent neural networks (RNNs) have shown outstanding performance on processing sequence data. However, they suffer from long training time, which demands parallel implementations of the training procedure. Paralleliza…

GPU

Temporally Consistent Long-Term Memory for 3D Single Object Tracking

2026-04-15 · Jaejoon Yoo, SuBeen Lee, Yerim Jeon, Miso Lee 외 arxiv

3D Single Object Tracking (3D-SOT) aims to localize a target object across a sequence of LiDAR point clouds, given its 3D bounding box in the first frame. Recent methods have adopted a memory-based approach to utilize pr…

Object TrackingPoint Clouds