paper-with-me

홈 › Papers

Deep Generative Networks For Sequence Prediction

2018-04-18 · Markus Beissinger

This thesis investigates unsupervised time series representation learning for sequence prediction problems, i.e. generating nice-looking input samples given a previous history, for high dimensional input sequences by decoupling the static input representation from the recurrent sequence representation. We introduce three models based on Generative Stochastic Networks (GSN) for unsupervised sequence learning and prediction. Experimental results for these three models are presented on pixels of sequential handwritten digit (MNIST) data, videos of low-resolution bouncing balls, and motion capture data. The main contribution of this thesis is to provide evidence that GSNs are a viable framework to learn useful representations of complex sequential input data, and to suggest a new framework for deep generative models to learn complex sequences by decoupling static input representations from dynamic time dependency representations.

📄 PDF Abstract BibTeX arXiv:1804.06546

Code (1)

mbeissinger/recurrent_gsn 공식 구현

Tasks

PredictionRepresentation LearningTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

RITA: a Study on Scaling Up Generative Protein Sequence Models

2022-05-11 · Daniel Hesslow, Niccoló Zanichelli, Pascal Notin, Iacopo Poli 외

In this work we introduce RITA: a suite of autoregressive generative models for protein sequences, with up to 1.2 billion parameters, trained on over 280 million protein sequences belonging to the UniRef-100 database. Su…

PredictionProtein Design

Generative Temporal Link Prediction via Self-tokenized Sequence Modeling

2019-11-26 · Yue Wang, Chenwei Zhang, Shen Wang, Philip S. Yu 외

We formalize networks with evolving structures as temporal networks and propose a generative link prediction model, Generative Link Sequence Modeling (GLSM), to predict future links for temporal networks. GLSM captures t…

Link PredictionPrediction

How Does Beam Search improve Span-Level Confidence Estimation in Generative Sequence Labeling?

2022-12-21 · Kazuma Hashimoto, Iftekhar Naim, Karthik Raman

Sequence labeling is a core task in text understanding for IE/IR systems. Text generation models have increasingly become the go-to solution for such tasks (e.g., entity extraction and dialog slot filling). While most re…

slot-fillingSlot FillingText Generation

Generative Bridging Network in Neural Sequence Prediction

2017-06-28 · Wenhu Chen, Guanlin Li, Shuo Ren, Shujie Liu 외

In order to alleviate data sparsity and overfitting problems in maximum likelihood estimation (MLE) for sequence prediction tasks, we propose the Generative Bridging Network (GBN), in which a novel bridge module is intro…

Abstractive Text SummarizationLanguage ModelingLanguage ModellingMachine Translation+3

Generative Bridging Network for Neural Sequence Prediction

2018-06-01 · NAACL 2018 6 · Wenhu Chen, Guanlin Li, Shuo Ren, Shujie Liu 외

In order to alleviate data sparsity and overfitting problems in maximum likelihood estimation (MLE) for sequence prediction tasks, we propose the Generative Bridging Network (GBN), in which a novel bridge module is intro…

Abstractive Text SummarizationImage CaptioningLanguage ModelingLanguage Modelling+6