paper-with-me

Papers

Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic

2024-02-22 · Nathaniel Weir, Kate Sanders, Orion Weller, Shreya Sharma, Dongwei Jiang, Zhengping Jiang, Bhavana Dalvi Mishra, Oyvind Tafjord, Peter Jansen, Peter Clark, Benjamin Van Durme

Recent language models enable new opportunities for structured reasoning with text, such as the construction of intuitive, proof-like textual entailment trees without relying on brittle formal logic. However, progress in this direction has been hampered by a long-standing lack of a clear protocol for determining what valid compositional entailment is. This absence causes noisy datasets and limited performance gains by modern neuro-symbolic engines. To address these problems, we formulate a consistent and theoretically grounded approach to annotating decompositional entailment and evaluate its impact on LLM-based textual inference. We find that our new dataset, RDTE (Recognizing Decompositional Textual Entailment), has a substantially higher internal consistency (+9%) than prior decompositional entailment datasets. We also find that training an RDTE-oriented entailment classifier via knowledge distillation and employing it in an entailment tree reasoning engine significantly improves both accuracy and proof quality, illustrating the practical benefit of this advance for textual inference.

📄 PDF Abstract BibTeX arXiv:2402.14798

Code (0)

등록된 구현이 없습니다.

Tasks

Formal LogicKnowledge DistillationNatural Language Inferencevalid

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Universal Decompositional Semantic Parsing

2019-10-22 · ACL 2020 6 · Elias Stengel-Eskin, Aaron Steven White, Sheng Zhang, Benjamin Van Durme

We introduce a transductive model for parsing into Universal Decompositional Semantics (UDS) representations, which jointly learns to map natural language utterances into UDS graph structures and annotate the graph with …

AttributePredictionSemantic Parsing

Cross-lingual Decompositional Semantic Parsing

2018-10-01 · EMNLP 2018 10 · Sheng Zhang, Xutai Ma, Rachel Rudinger, Kevin Duh 외

We introduce the task of cross-lingual decompositional semantic parsing: mapping content provided in a source language into a decompositional semantic analysis based on a target language. We present: (1) a form of decomp…

Semantic Parsing

Beyond Context Limits: Subconscious Threads for Long-Horizon Reasoning

2025-07-22 · Hongyin Luo, Nathaniel Morgan, Tina Li, Derek Zhao 외 arxiv

To break the context limits of large language models (LLMs) that bottleneck reasoning accuracy and efficiency, we propose the Thread Inference Model (TIM), a family of LLMs trained for recursive and decompositional probl…

Information Retrieval

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

2023-07-25 · Hexuan Deng, Xin Zhang, Meishan Zhang, Xuebo Liu 외

In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing. We first introduce a cascade model for UDS parsing that decomposes the complex parsing task into semantically appr…

AttributeData AugmentationSemantic Parsing

The Universal Decompositional Semantics Dataset and Decomp Toolkit

2019-09-30 · LREC 2020 5 · Aaron Steven White, Elias Stengel-Eskin, Siddharth Vashishtha, Venkata Govindarajan 외

We present the Universal Decompositional Semantics (UDS) dataset (v1.0), which is bundled with the Decomp toolkit (v0.1). UDS1.0 unifies five high-quality, decompositional semantics-aligned annotation sets within a singl…