paper-with-me

홈 › Papers

Moving Toward High Precision Dynamical Modelling in Hidden Markov Models

2016-07-01 · Sébastien Gagnon, Jean Rouat

Hidden Markov Model (HMM) is often regarded as the dynamical model of choice in many fields and applications. It is also at the heart of most state-of-the-art speech recognition systems since the 70's. However, from Gaussian mixture models HMMs (GMM-HMM) to deep neural network HMMs (DNN-HMM), the underlying Markovian chain of state-of-the-art models did not changed much. The "left-to-right" topology is mostly always employed because very few other alternatives exist. In this paper, we propose that finely-tuned HMM topologies are essential for precise temporal modelling and that this approach should be investigated in state-of-the-art HMM system. As such, we propose a proof-of-concept framework for learning efficient topologies by pruning down complex generic models. Speech recognition experiments that were conducted indicate that complex time dependencies can be better learned by this approach than with classical "left-to-right" models.

📄 PDF Abstract BibTeX arXiv:1607.00359

Code (0)

등록된 구현이 없습니다.

Tasks

speech-recognitionSpeech RecognitionVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Mathematical Formalism for Memory Compression in Selective State Space Models

2024-10-04 · Siddhanth Bhat

State space models (SSMs) have emerged as a powerful framework for modelling long-range dependencies in sequence data. Unlike traditional recurrent neural networks (RNNs) and convolutional neural networks (CNNs), SSMs of…

State Space ModelsTime Series Forecasting

Moving Object Segmentation in Point Cloud Data using Hidden Markov Models

2024-10-24 · Vedant Bhandari, Jasmin James, Tyson Phillips, P. Ross McAree

Autonomous agents require the capability to identify dynamic objects in their environment for safe planning and navigation. Incomplete and erroneous dynamic detections jeopardize the agent's ability to accomplish its tas…

Semantic Segmentation

Pre-training of Recurrent Neural Networks via Linear Autoencoders

2014-12-01 · NeurIPS 2014 12 · Luca Pasa, Alessandro Sperduti

We propose a pre-training technique for recurrent neural networks based on linear autoencoder networks for sequences, i.e. linear dynamical systems modelling the target sequences. We start by giving a closed form solutio…

Decoding finger movements from ECoG signals using switching linear models

2012-03-06 · Front. Neurosci., Sec. Neuroprosthetics 2012 3 · Rémi Flamary, Alain Rakotomamonjy

One of the most interesting challenges in ECoG-based Brain-Machine Interface is movement prediction. Being able to perform such a prediction paves the way to high-degree precision command for a machine such as a robotic …

Brain Decoding

Entity Decisions in Neural Language Modelling: Approaches and Problems

2019-06-01 · WS 2019 6 · Jenny Kunz, Christian Hardmeier

We explore different approaches to explicit entity modelling in language models (LM). We independently replicate two existing models in a controlled setup, introduce a simplified variant of one of the models and analyze …

Language Modelling