A Generative Approach to Titling and Clustering Wikipedia Sections
We evaluate the performance of transformer encoders with various decoders for information organization through a new task: generation of section headings for Wikipedia articles. Our analysis shows that decoders containing attention mechanisms over the encoder output achieve high-scoring results by generating extractive text. In contrast, a decoder without attention better facilitates semantic encoding and can be used to generate section embeddings. We additionally introduce a new loss function, which further encourages the decoder to generate high-quality embeddings.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesClusteringDecoderMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Thematic Similarity Metric from Article Sections Using Triplet Networks
In this paper we suggest to leverage the partition of articles into sections, in order to learn thematic similarity metric between sentences. We assume that a sentence is thematically closer to sentences within its secti…
ArticlesClusteringCollaborative FilteringDocument Summarization+6WikiOmnia: generative QA corpus on the whole Russian Wikipedia
The General QA field has been developing the methodology referencing the Stanford Question answering dataset (SQuAD) as the significant benchmark. However, compiling factual questions is accompanied by time- and labour-c…
Question AnsweringWikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sections
Datasets for data-to-text generation typically focus either on multi-domain, single-sentence generation or on single-domain, long-form generation. In this work, we cast generating Wikipedia sections as a data-to-text gen…
Data-to-Text GenerationFormSentenceText GenerationRecognizing Biographical Sections in Wikipedia
Weakly Supervised Multilingual Causality Extraction from Wikipedia
We present a method for extracting causality knowledge from Wikipedia, such as Protectionism -{\textgreater} Trade war, where the cause and effect entities correspond to Wikipedia articles. Such causality knowledge is ea…
Articles