paper-with-me

홈 › Papers

Improving Human Text Comprehension through Semi-Markov CRF-based Neural Section Title Generation

2019-04-15 · NAACL 2019 6 · Sebastian Gehrmann, Steven Layne, Franck Dernoncourt

Titles of short sections within long documents support readers by guiding their focus towards relevant passages and by providing anchor-points that help to understand the progression of the document. The positive effects of section titles are even more pronounced when measured on readers with less developed reading abilities, for example in communities with limited labeled text resources. We, therefore, aim to develop techniques to generate section titles in low-resource environments. In particular, we present an extractive pipeline for section title generation by first selecting the most salient sentence and then applying deletion-based compression. Our compression approach is based on a Semi-Markov Conditional Random Field that leverages unsupervised word-representations such as ELMo or BERT, eliminating the need for a complex encoder-decoder architecture. The results show that this approach leads to competitive performance with sequence-to-sequence models with high resources, while strongly outperforming it with low resources. In a human-subject study across subjects with varying reading abilities, we find that our section titles improve the speed of completing comprehension tasks while retaining similar accuracy.

📄 PDF Abstract BibTeX arXiv:1904.07142

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderReading ComprehensionSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Weight Decay 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Reading Comprehension Ability Test-A Turing Test for Reading Comprehension

2019-09-05 · Yuan Miao, Gongqi Lin, Yidan Hu, Chunyan Miao

Reading comprehension is an important ability of human intelligence. Literacy and numeracy are two most essential foundation for people to succeed at study, at work and in life. Reading comprehension ability is a core co…

Reading Comprehension

Neural semi-Markov CRF for Monolingual Word Alignment

2021-06-04 · ACL 2021 5 · Wuwei Lan, Chao Jiang, Wei Xu

Monolingual word alignment is important for studying fine-grained editing operations (i.e., deletion, addition, and substitution) in text-to-text generation tasks, such as paraphrase generation, text simplification, neut…

Paraphrase GenerationSentenceSentence-Pair ClassificationText Generation+2

Weak Semi-Markov CRFs for NP Chunking in Informal Text

2018-10-19 · Aldrian Obaja Muis, Wei Lu

This paper introduces a new annotated corpus based on an existing informal text corpus: the NUS SMS Corpus (Chen and Kan, 2013). The new corpus includes 76,490 noun phrases from 26,500 SMS messages, annotated by universi…

Chunking

Filtered Semi-Markov CRF

2023-11-29 · Urchade Zaratiana, Nadi Tomeh, Niama El Khbir, Pierre Holat 외

Semi-Markov CRF has been proposed as an alternative to the traditional Linear Chain CRF for text segmentation tasks such as Named Entity Recognition (NER). Unlike CRF, which treats text segmentation as token-level predic…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2

Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension

2021-09-14 · EMNLP 2021 11 · Naoya Inoue, Harsh Trivedi, Steven Sinha, Niranjan Balasubramanian 외

How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text.…

2kMulti-Hop Reading ComprehensionReading Comprehension