paper-with-me

홈 › Papers

Decontextualization: Making Sentences Stand-Alone

2021-02-09 · Eunsol Choi, Jennimaria Palomaki, Matthew Lamm, Tom Kwiatkowski, Dipanjan Das, Michael Collins

Models for question answering, dialogue agents, and summarization often interpret the meaning of a sentence in a rich context and use that meaning in a new context. Taking excerpts of text can be problematic, as key pieces may not be explicit in a local window. We isolate and define the problem of sentence decontextualization: taking a sentence together with its context and rewriting it to be interpretable out of context, while preserving its meaning. We describe an annotation procedure, collect data on the Wikipedia corpus, and use the data to train models to automatically decontextualize sentences. We present preliminary studies that show the value of sentence decontextualization in a user facing task, and as preprocessing for systems that perform document understanding. We argue that decontextualization is an important subtask in many downstream applications, and that the definitions and resources provided can benefit tasks that operate on sentences that occur in a richer context.

📄 PDF Abstract BibTeX arXiv:2102.05169

Code (0)

등록된 구현이 없습니다.

Tasks

document understandingQuestion AnsweringSentence

Similar Papers 제목 키워드 기반

Get the gist? Using large language models for few-shot decontextualization

2023-10-10 · Benjamin Kane, Lenhart Schubert

In many NLP applications that involve interpreting sentences within a rich context -- for instance, information retrieval systems or dialogue systems -- it is desirable to be able to preserve the sentence in a form that …

Information RetrievalLanguage ModelingLanguage ModellingLarge Language Model+2

Molecular Facts: Desiderata for Decontextualization in LLM Fact Verification

2024-06-28 · Anisha Gunjal, Greg Durrett

Automatic factuality verification of large language model (LLM) generations is becoming more and more widely used to combat hallucinations. A major point of tension in the literature is the granularity of this fact-check…

Fact CheckingFact VerificationLanguage ModelingLanguage Modelling+1

DnDScore: Decontextualization and Decomposition for Factuality Verification in Long-Form Text Generation

2024-12-17 · Miriam Wanner, Benjamin Van Durme, Mark Dredze

The decompose-then-verify strategy for verification of Large Language Model (LLM) generations decomposes claims that are then independently verified. Decontextualization augments text (claims) to ensure it can be verifie…

FormLanguage ModelingLanguage ModellingLarge Language Model+1

Learning to Reject with a Fixed Predictor: Application to Decontextualization

2023-01-22 · Christopher Mohri, Daniel Andor, Eunsol Choi, Michael Collins

We study the problem of classification with a reject option for a fixed predictor, applicable in natural language processing. We introduce a new problem formulation for this scenario, and an algorithm minimizing a new su…

Making People Laugh like a Pro: Analysing Humor Through Stand-Up Comedy

2022-06-01 · LREC 2022 6 · Beatrice Turano, Carlo Strapparava

The analysis of humor using computational tools has gained popularity in the past few years, and a lot of resources have been built for this purpose. However, most of these resources focus on standalone jokes or on occas…