paper-with-me

Papers

Visual Causal Feature Learning

2014-12-07 · Krzysztof Chalupka, Pietro Perona, Frederick Eberhardt

We provide a rigorous definition of the visual cause of a behavior that is broadly applicable to the visually driven behavior in humans, animals, neurons, robots and other perceiving systems. Our framework generalizes standard accounts of causal learning to settings in which the causal variables need to be constructed from micro-variables. We prove the Causal Coarsening Theorem, which allows us to gain causal knowledge from observational data with minimal experimental effort. The theorem provides a connection to standard inference techniques in machine learning that identify features of an image that correlate with, but may not cause, the target behavior. Finally, we propose an active learning scheme to learn a manipulator function that performs optimal manipulations on the image to automatically identify the visual cause of a target behavior. We illustrate our inference and learning algorithms in experiments based on both synthetic and real data.

📄 PDF Abstract BibTeX arXiv:1412.2309

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Similar Papers 제목 키워드 기반

CausalRec: Causal Inference for Visual Debiasing in Visually-Aware Recommendation

2021-07-06 · Ruihong Qiu, Sen Wang, Zhi Chen, Hongzhi Yin 외

Visually-aware recommendation on E-commerce platforms aims to leverage visual information of items to predict a user's preference. It is commonly observed that user's attention to visual features does not always reflect …

Causal InferencecounterfactualCounterfactual InferenceRecommendation Systems

Extracting Causal Visual Features for Limited label Classification

2021-03-23 · Mohit Prabhushankar, Ghassan AlRegib

Neural networks trained to classify images do so by identifying features that allow them to distinguish between classes. These sets of features are either causal or context dependent. Grad-CAM is a popular method of visu…

ClassificationGeneral Classification

Mutually Causal Semantic Distillation Network for Zero-Shot Learning

2026-03-18 · Shiming Chen, Shuhuang Chen, Guo-Sen Xie, Xinge You arxiv

Zero-shot learning (ZSL) aims to recognize the unseen classes in the open-world guided by the side-information (e.g., attributes). Its key task is how to infer the latent semantic knowledge between visual and attribute f…

Zero-Shot Learning

Causal ImageNet: How to discover spurious features in Deep Learning?

2021-09-29 · ICLR 2022 4 · Sahil Singla, Soheil Feizi

A key reason for the lack of reliability of deep neural networks in the real world is their heavy reliance on {\it spurious} input features that are causally unrelated to the true label. Focusing on image classifications…

AttributeDeep Learning

Visual Causal Scene Refinement for Video Question Answering

2023-05-07 · Yushen Wei, Yang Liu, Hong Yan, Guanbin Li 외

Existing methods for video question answering (VideoQA) often suffer from spurious correlations between different modalities, leading to a failure in identifying the dominant visual evidence and the intended question. Mo…

Contrastive LearningQuestion AnsweringRelational ReasoningVideo Question Answering