paper-with-me

홈 › Papers

T-CVAE: Transformer-Based Conditioned Variational Autoencoder for Story Completion

2019-07-01 · International Joint Conference on Artificial Intelligence 2019 7 · Tianming Wang, Xiaojun Wan

Story completion is a very challenging task of generating the missing plot for an incomplete story, which requires not only understanding but also inference of the given contextual clues. In this paper, we present a novel conditional variational autoencoder based on Transformer for missing plot generation. Our model uses shared attention layers for encoder and decoder, which make the most of the contextual clues, and a latent variable for learning the distribution of coherent story plots. Through drawing samples from the learned distribution, diverse reasonable plots can be generated. Both automatic and manual evaluations show that our model generates better story plots than state-of-the-art models in terms of readability, diversity and coherence.

📄 PDF Abstract BibTeX

Code (1)

sodawater/t-cvae 공식 구현 tf

Tasks

DecoderDiversityStory Completion

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Transformer-Based Conditioned Variational Autoencoder for Dialogue Generation

2022-10-22 · Huihui Yang

In human dialogue, a single query may elicit numerous appropriate responses. The Transformer-based dialogue model produces frequently occurring sentences in the corpus since it is a one-to-one mapping function. CVAE is a…

Dialogue Generation

Transformer-based Conditional Variational Autoencoder for Controllable Story Generation

2021-01-04 · Le Fang, Tao Zeng, Chaochun Liu, Liefeng Bo 외

We investigate large-scale latent variable models (LVMs) for neural story generation -- an under-explored application for open-domain long text -- with objectives in two threads: generation effectiveness and controllabil…

DecoderRepresentation LearningStory Generation

RGCVAE: Relational Graph Conditioned Variational Autoencoder for Molecule Design

2023-05-19 · Davide Rigoni, Nicolò Navarin, Alessandro Sperduti

Identifying molecules that exhibit some pre-specified properties is a difficult problem to solve. In the last few years, deep generative models have been used for molecule generation. Deep Graph Variational Autoencoders …

Plan-CVAE: A Planning-based Conditional Variational Autoencoder for Story Generation

2020-10-01 · CCL 2020 10 · Lin Wang, Juntao Li, Rui Yan, Dongyan Zhao

Story generation is a challenging task of automatically creating natural languages to describe a sequence of events, which requires outputting text with not only a consistent topic but also novel wordings. Although many …

DiversityStory Generation

Diversity-aware Event Prediction based on a Conditional Variational Autoencoder with Reconstruction

2019-11-01 · WS 2019 11 · Hirokazu Kiyomaru, Kazumasa Omura, Yugo Murawaki, Daisuke Kawahara 외

Typical event sequences are an important class of commonsense knowledge. Formalizing the task as the generation of a next event conditioned on a current event, previous work in event prediction employs sequence-to-sequen…

Diversity