Improving Semantic Relevance for Sequence-to-Sequence Learning of Chinese Social Media Text Summarization
Current Chinese social media text summarization models are based on an encoder-decoder framework. Although its generated summaries are similar to source texts literally, they have low semantic relevance. In this work, our goal is to improve semantic relevance between source texts and summaries for Chinese social media summarization. We introduce a Semantic Relevance Based neural model to encourage high semantic similarity between texts and summaries. In our model, the source text is represented by a gated attention encoder, while the summary representation is produced by a decoder. Besides, the similarity score between the representations is maximized during training. Our experiments show that the proposed model outperforms baseline systems on a social media corpus.
Code (1)
Tasks
DecoderSemantic SimilaritySemantic Textual SimilarityText SummarizationSimilar Papers 제목 키워드 기반
Generating Chinese Classical Poems with RNN Encoder-Decoder
We take the generation of Chinese classical poem lines as a sequence-to-sequence learning problem, and build a novel system based on the RNN Encoder-Decoder structure to generate quatrains (Jueju in Chinese), with a topi…
DecoderAutoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization
Most of the current abstractive text summarization models are based on the sequence-to-sequence model (Seq2Seq). The source content of social media is long and noisy, so it is difficult for Seq2Seq to learn an accurate s…
Abstractive Text SummarizationText SummarizationIncorporating Deep Syntactic and Semantic Knowledge for Chinese Sequence Labeling with GCN
Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded…
Chinese Word SegmentationPart-Of-Speech TaggingSemantic ParsingA Hierarchical Attention Based Seq2seq Model for Chinese Lyrics Generation
In this paper, we comprehensively study on context-aware generation of Chinese song lyrics. Conventional text generative models generate a sequence or sentence word by word, failing to consider the contextual relationshi…
SentenceRegularizing Output Distribution of Abstractive Chinese Social Media Text Summarization for Improved Semantic Consistency
Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with th…
Abstractive Text SummarizationText Summarization