paper-with-me

Papers

Towards the Reusability and Compositionality of Causal Representations

2024-03-14 · Davide Talon, Phillip Lippe, Stuart James, Alessio Del Bue, Sara Magliacane

Causal Representation Learning (CRL) aims at identifying high-level causal factors and their relationships from high-dimensional observations, e.g., images. While most CRL works focus on learning causal representations in a single environment, in this work we instead propose a first step towards learning causal representations from temporal sequences of images that can be adapted in a new environment, or composed across multiple related environments. In particular, we introduce DECAF, a framework that detects which causal factors can be reused and which need to be adapted from previously learned causal representations. Our approach is based on the availability of intervention targets, that indicate which variables are perturbed at each time step. Experiments on three benchmark datasets show that integrating our framework with four state-of-the-art CRL approaches leads to accurate representations in a new environment with only a few samples.

📄 PDF Abstract BibTeX arXiv:2403.09830

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningTemporal Sequences

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings

2023-01-21 · Rohan Pandey

Past work probing compositionality in sentence embedding models faces issues determining the causal impact of implicit syntax representations. Given a sentence, we construct a neural module net based on its syntax parse …

Semantic CompositionSentenceSentence EmbeddingSentence-Embedding+1

Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective

2021-11-29 · CVPR 2022 1 · Yuejiang Liu, Riccardo Cadei, Jonas Schweizer, Sherwin Bahmani 외

Learning behavioral patterns from observational data has been a de-facto approach to motion forecasting. Yet, the current paradigm suffers from two shortcomings: brittle under distribution shifts and inefficient for know…

Motion ForecastingOut-of-Distribution GeneralizationTransfer Learning

Transferable Delay-Aware Reinforcement Learning via Implicit Causal Graph Modeling

2026-05-12 · Chenran Zhao, Dianxi Shi, Yaowen Zhang, Chunping Qiu 외 arxiv

Random delays weaken the temporal correspondence between actions and subsequent state feedback, making it difficult for agents to identify the true propagation process of action effects. In cross-task scenarios, changes …

Reinforcement LearningContinuous Control

Exploring Compositionality in Vision Transformers using Wavelet Representations

2025-12-30 · Akshad Shyam Purushottamdas, Pranav K Nayak, Divya Mehul Rajparia, Deekshith Patel 외 arxiv

While insights into the workings of the transformer model have largely emerged by analysing their behaviour on language tasks, this work investigates the representations learnt by the Vision Transformer (ViT) encoder thr…

Representation Learning

Geometric Signatures of Compositionality Across a Language Model's Lifetime

2024-10-02 · Jin Hwa Lee, Thomas Jiralerspong, Lei Yu, Yoshua Bengio 외

By virtue of linguistic compositionality, few syntactic rules and a finite lexicon can generate an unbounded number of sentences. That is, language, though seemingly high-dimensional, can be explained using relatively fe…