paper-with-me

Papers

Generating Natural Language Inference Chains

2016-06-04 · Vladyslav Kolesnyk, Tim Rocktäschel, Sebastian Riedel

The ability to reason with natural language is a fundamental prerequisite for many NLP tasks such as information extraction, machine translation and question answering. To quantify this ability, systems are commonly tested whether they can recognize textual entailment, i.e., whether one sentence can be inferred from another one. However, in most NLP applications only single source sentences instead of sentence pairs are available. Hence, we propose a new task that measures how well a model can generate an entailed sentence from a source sentence. We take entailment-pairs of the Stanford Natural Language Inference corpus and train an LSTM with attention. On a manually annotated test set we found that 82% of generated sentences are correct, an improvement of 10.3% over an LSTM baseline. A qualitative analysis shows that this model is not only capable of shortening input sentences, but also inferring new statements via paraphrasing and phrase entailment. We then apply this model recursively to input-output pairs, thereby generating natural language inference chains that can be used to automatically construct an entailment graph from source sentences. Finally, by swapping source and target sentences we can also train a model that given an input sentence invents additional information to generate a new sentence.

📄 PDF Abstract BibTeX arXiv:1606.01404

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNatural Language InferenceQuestion AnsweringSentence

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

ChainReaction: Causal Chain-Guided Reasoning for Modular and Explainable Causal-Why Video Question Answering

2025-08-28 · Paritosh Parmar, Eric Peh, Basura Fernando arxiv

Existing Causal-Why Video Question Answering (VideoQA) models often struggle with higher-order reasoning, relying on opaque, monolithic pipelines that entangle video understanding, causal inference, and answer generation…

Video Question AnsweringAnswer GenerationCausal Inference

Fine-Tuning with Divergent Chains of Thought Boosts Reasoning Through Self-Correction in Language Models

2024-07-03 · Haritz Puerto, Tilek Chubakov, Xiaodan Zhu, Harish Tayyar Madabushi 외

Requiring a Large Language Model to generate intermediary reasoning steps has been shown to be an effective way of boosting performance. In fact, it has been found that instruction tuning on these intermediary reasoning …

Language ModellingLarge Language Model

Towards Lexical Chains for Knowledge-Graph-based Word Embeddings

2017-09-01 · RANLP 2017 9 · Kiril Simov, Svetla Boytcheva, Petya Osenova

Word vectors with varying dimensionalities and produced by different algorithms have been extensively used in NLP. The corpora that the algorithms are trained on can contain either natural language text (e.g. Wikipedia o…

ArticlesLanguage ModelingLanguage ModellingLearning Word Embeddings+2

ChatGraph: Chat with Your Graphs

2024-01-23 · Yun Peng, Sen Lin, Qian Chen, Lyu Xu 외

Graph analysis is fundamental in real-world applications. Traditional approaches rely on SPARQL-like languages or clicking-and-dragging interfaces to interact with graph data. However, these methods either require users …

Language ModelingLanguage ModellingLarge Language ModelRetrieval

ReCEval: Evaluating Reasoning Chains via Correctness and Informativeness

2023-04-21 · Archiki Prasad, Swarnadeep Saha, Xiang Zhou, Mohit Bansal

Multi-step reasoning ability is fundamental to many natural language tasks, yet it is unclear what constitutes a good reasoning chain and how to evaluate them. Most existing methods focus solely on whether the reasoning …

InformativenessNatural Language Inferencevalid