paper-with-me

Papers

Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs

2024-03-12 · Tianqing Fang, Zeming Chen, Yangqiu Song, Antoine Bosselut

Event commonsense reasoning requires the ability to reason about the relationship between events, as well as infer implicit context underlying that relationship. However, data scarcity makes it challenging for language models to learn to generate commonsense inferences for contexts and questions involving interactions between complex events. To address this demand, we present COM2 (COMplex COMmonsense), a new dataset created by sampling multi-hop logical queries (e.g., the joint effect or cause of both event A and B, or the effect of the effect of event C) from an existing commonsense knowledge graph (CSKG), and verbalizing them using handcrafted rules and large language models into multiple-choice and text generation questions. Our experiments show that language models trained on COM2 exhibit significant improvements in complex reasoning ability, resulting in enhanced zero-shot performance in both in-domain and out-of-domain tasks for question answering and generative commonsense reasoning, without expensive human annotations. Code and data are available at https://github.com/tqfang/complex-commonsense-reasoning.

📄 PDF Abstract BibTeX arXiv:2403.07398

Code (1)

tqfang/complex-commonsense-reasoning 공식 구현 pytorch

Tasks

Knowledge GraphsMultiple-choiceQuestion AnsweringText Generation

Similar Papers 제목 키워드 기반

CoLoTa: A Dataset for Entity-based Commonsense Reasoning over Long-Tail Knowledge

2025-04-20 · Armin Toroghi, Willis Guo, Scott Sanner

The rise of Large Language Models (LLMs) has redefined the AI landscape, particularly due to their ability to encode factual and commonsense knowledge, and their outstanding performance in tasks requiring reasoning. Desp…

Claim VerificationGraph Question AnsweringQuestion Answering

Extending Automated Deduction for Commonsense Reasoning

2020-03-29 · Tanel Tammet

Commonsense reasoning has long been considered as one of the holy grails of artificial intelligence. Most of the recent progress in the field has been achieved by novel machine learning algorithms for natural language pr…

BIG-bench Machine LearningLogical Reasoning

LOGICAL-COMMONSENSEQA: A Benchmark for Logical Commonsense Reasoning

2026-01-23 · Obed Junias, Maria Leonor Pacheco arxiv

Commonsense reasoning often involves evaluating multiple plausible interpretations rather than selecting a single atomic answer, yet most benchmarks rely on single-label evaluation, obscuring whether statements are joint…

Archer: A Human-Labeled Text-to-SQL Dataset with Arithmetic, Commonsense and Hypothetical Reasoning

2024-02-19 · Danna Zheng, Mirella Lapata, Jeff Z. Pan

We present Archer, a challenging bilingual text-to-SQL dataset specific to complex reasoning, including arithmetic, commonsense and hypothetical reasoning. It contains 1,042 English questions and 1,042 Chinese questions,…

Text to SQLText-To-SQL

On the Security Risks of Knowledge Graph Reasoning

2023-05-03 · Zhaohan Xi, Tianyu Du, Changjiang Li, Ren Pang 외

Knowledge graph reasoning (KGR) -- answering complex logical queries over large knowledge graphs -- represents an important artificial intelligence task, entailing a range of applications (e.g., cyber threat hunting). Ho…

Knowledge Graphs