paper-with-me

Papers

CommonsenseVIS: Visualizing and Understanding Commonsense Reasoning Capabilities of Natural Language Models

2023-07-23 · Xingbo Wang, Renfei Huang, Zhihua Jin, Tianqing Fang, Huamin Qu

Recently, large pretrained language models have achieved compelling performance on commonsense benchmarks. Nevertheless, it is unclear what commonsense knowledge the models learn and whether they solely exploit spurious patterns. Feature attributions are popular explainability techniques that identify important input concepts for model outputs. However, commonsense knowledge tends to be implicit and rarely explicitly presented in inputs. These methods cannot infer models' implicit reasoning over mentioned concepts. We present CommonsenseVIS, a visual explanatory system that utilizes external commonsense knowledge bases to contextualize model behavior for commonsense question-answering. Specifically, we extract relevant commonsense knowledge in inputs as references to align model behavior with human knowledge. Our system features multi-level visualization and interactive model probing and editing for different concepts and their underlying relations. Through a user study, we show that CommonsenseVIS helps NLP experts conduct a systematic and scalable visual analysis of models' relational reasoning over concepts in different situations.

📄 PDF Abstract BibTeX arXiv:2307.12382

Code (0)

등록된 구현이 없습니다.

Tasks

Question AnsweringRelational Reasoning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Social Commonsense Reasoning with Multi-Head Knowledge Attention

2020-10-12 · Findings of the Association for Computational Linguistics 2020 · Debjit Paul, Anette Frank

Social Commonsense Reasoning requires understanding of text, knowledge about social events and their pragmatic implications, as well as commonsense reasoning skills. In this work we propose a novel multi-head knowledge a…

counterfactualCounterfactual ReasoningNatural Language Inference

Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models

2023-12-29 · Yuqing Wang, Yun Zhao

The burgeoning interest in Multimodal Large Language Models (MLLMs), such as OpenAI's GPT-4V(ision), has significantly impacted both academic and industrial realms. These models enhance Large Language Models (LLMs) with …

HellaSwag

Zero-shot Commonsense Reasoning over Machine Imagination

2024-10-12 · Hyuntae Park, Yeachan Kim, Jun-Hyung Park, SangKeun Lee

Recent approaches to zero-shot commonsense reasoning have enabled Pre-trained Language Models (PLMs) to learn a broad range of commonsense knowledge without being tailored to specific situations. However, they often suff…

Question AnsweringVisual Question Answering

Natural Language Processing with Commonsense Knowledge: A Survey

2021-08-10 · Yubo Xie, Zonghui Liu, Zongyang Ma, Fanyuan Meng 외

Commonsense knowledge is essential for advancing natural language processing (NLP) by enabling models to engage in human-like reasoning, which requires a deeper understanding of context and often involves making inferenc…

Survey

Probing Commonsense Explanation in Dialogue Response Generation

2021-04-19 · Findings (EMNLP) 2021 11 · Pei Zhou, Pegah Jandaghi, Bill Yuchen Lin, Justin Cho 외

Humans use commonsense reasoning (CSR) implicitly to produce natural and coherent responses in conversations. Aiming to close the gap between current response generation (RG) models and human communication abilities, we …

Common Sense ReasoningResponse Generation