paper-with-me

홈 › Papers

What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models

2023-10-10 · CVPR 2024 1 · Letian Zhang, Xiaotong Zhai, Zhongkai Zhao, Yongshuo Zong, Xin Wen, Bingchen Zhao

Counterfactual reasoning, a fundamental aspect of human cognition, involves contemplating alternatives to established facts or past events, significantly enhancing our abilities in planning and decision-making. In light of the advancements in current multi-modal large language models, we explore their effectiveness in counterfactual reasoning. To facilitate this investigation, we introduce a novel dataset, C-VQA, specifically designed to test the counterfactual reasoning capabilities of modern multi-modal large language models. This dataset is constructed by infusing original questions with counterfactual presuppositions, spanning various types such as numerical and boolean queries. It encompasses a mix of real and synthetic data, representing a wide range of difficulty levels. Our thorough evaluations of contemporary vision-language models using this dataset have revealed substantial performance drops, with some models showing up to a 40% decrease, highlighting a significant gap between current models and human-like vision reasoning capabilities. We hope our dataset will serve as a vital benchmark for evaluating the counterfactual reasoning capabilities of models. Code and dataset are publicly available at https://bzhao.me/C-VQA/.

📄 PDF Abstract BibTeX arXiv:2310.06627

Code (1)

letian2003/c-vqa 공식 구현 pytorch

Tasks

BenchmarkingCode GenerationcounterfactualCounterfactual ReasoningDecision MakingVisual Question Answering (VQA)

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Reasoning Elicitation in Language Models via Counterfactual Feedback

2024-10-02 · Alihan Hüyük, Xinnuo Xu, Jacqueline Maasch, Aditya V. Nori 외

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge …

counterfactualQuestion Answering

Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Models

2024-02-14 · Martha Lewis, Melanie Mitchell

Large language models (LLMs) have performed well on several reasoning benchmarks, including ones that test analogical reasoning abilities. However, it has been debated whether they are actually performing humanlike abstr…

counterfactual

Counterfactual Story Reasoning and Generation

2019-09-09 · IJCNLP 2019 11 · Lianhui Qin, Antoine Bosselut, Ari Holtzman, Chandra Bhagavatula 외

Counterfactual reasoning requires predicting how alternative events, contrary to what actually happened, might have resulted in different outcomes. Despite being considered a necessary component of AI-complete systems, f…

counterfactualCounterfactual ReasoningText Generation

Causal Temporal Reasoning for Markov Decision Processes

2022-12-16 · Milad Kazemi, Nicola Paoletti

We introduce $\textit{PCFTL (Probabilistic CounterFactual Temporal Logic)}$, a new probabilistic temporal logic for the verification of Markov Decision Processes (MDP). PCFTL is the first to include operators for causal …

counterfactualCounterfactual ReasoningSafe Reinforcement Learning

Causal Regime Detection in Energy Markets With Augmented Time Series Structural Causal Models

2025-11-06 · Dennis Thumm arxiv

Energy markets exhibit complex causal relationships between weather patterns, generation technologies, and price formation, with regime changes occurring continuously rather than at discrete break points. Current approac…