Causal Action Influence Aware Counterfactual Data Augmentation
Offline data are both valuable and practical resources for teaching robots complex behaviors. Ideally, learning agents should not be constrained by the scarcity of available demonstrations, but rather generalize beyond the training distribution. However, the complexity of real-world scenarios typically requires huge amounts of data to prevent neural network policies from picking up on spurious correlations and learning non-causal relationships. We propose CAIAC, a data augmentation method that can create feasible synthetic transitions from a fixed dataset without having access to online environment interactions. By utilizing principled methods for quantifying causal influence, we are able to perform counterfactual reasoning by swapping $\it{action}$-unaffected parts of the state-space between independent trajectories in the dataset. We empirically show that this leads to a substantial increase in robustness of offline learning algorithms against distributional shift.
Code (1)
Tasks
counterfactualCounterfactual ReasoningData AugmentationSimilar Papers 제목 키워드 기반
Multi-Agent Causal Reasoning for Suicide Ideation Detection Through Online Conversations
Suicide remains a pressing global public health concern. While social media platforms offer opportunities for early risk detection through online conversation trees, existing approaches face two major limitations: (1) Th…
Decision MakingCounterfactual Influence in Markov Decision Processes
Our work addresses a fundamental problem in the context of counterfactual inference for Markov Decision Processes (MDPs). Given an MDP path $\tau$, this kind of inference allows us to derive counterfactual paths $\tau'$ …
counterfactualCounterfactual InferenceCausality Laundering: Denial-Feedback Leakage in Tool-Calling LLM Agents
Tool-calling LLM agents can read private data, invoke external services, and trigger real-world actions, creating a security problem at the point of tool execution. We identify a denial-feedback leakage pattern, which we…
Estimating Online Influence Needs Causal Modeling! Counterfactual Analysis of Social Media Engagement
Understanding true influence in social media requires distinguishing correlation from causation--particularly when analyzing misinformation spread. While existing approaches focus on exposure metrics and network structur…
Causal InferencecounterfactualMisinformationGenerating Causal Temporal Interaction Graphs for Counterfactual Validation of Temporal Link Prediction
Temporal link prediction (TLP) models are commonly evaluated based on predictive accuracy, yet such evaluations do not assess whether these models capture the causal mechanisms that govern temporal interactions. In this …
Link Prediction