An Encoder with non-Sequential Dependency for Neural Data-to-Text Generation
Data-to-text generation aims to generate descriptions given a structured input data (i.e., a table with multiple records). Existing neural methods for encoding input data can be divided into two categories: a) pooling based encoders which ignore dependencies between input records or b) recurrent encoders which model only sequential dependencies between input records. In our investigation, although the recurrent encoder generally outperforms the pooling based encoder by learning the sequential dependencies, it is sensitive to the order of the input records (i.e., performance decreases when injecting the random shuffling noise over input data). To overcome this problem, we propose to adopt the self-attention mechanism to learn dependencies between arbitrary input records. Experimental results show the proposed method achieves comparable results and remains stable under random shuffling over input data.
Code (0)
등록된 구현이 없습니다.
Tasks
Data-to-Text GenerationText GenerationSimilar Papers 제목 키워드 기반
Non-autoregressive Personalized Bundle Generation
The personalized bundle generation problem, which aims to create a preferred bundle for user from numerous candidate items, receives increasing attention in recommendation. However, existing works ignore the order-invari…
DecoderGraph Neural NetworkInductive BiasGraph Masked Autoencoder for Sequential Recommendation
While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from p…
Contrastive LearningData AugmentationRecommendation SystemsSequential RecommendationAn Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
Generating semantically coherent responses is still a major challenge in dialogue generation. Different from conventional text generation tasks, the mapping between inputs and responses in conversations is more complicat…
Dialogue GenerationText GenerationTractable Transformers for Flexible Conditional Generation
Non-autoregressive (NAR) generative models are valuable because they can handle diverse conditional generation tasks in a more principled way than their autoregressive (AR) counterparts, which are constrained by sequenti…
DecoderPredicting Music Hierarchies with a Graph-Based Neural Decoder
This paper describes a data-driven framework to parse musical sequences into dependency trees, which are hierarchical structures used in music cognition research and music analysis. The parsing involves two steps. First,…
Decoder