paper-with-me

홈 › Papers

COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning

2023-11-01 · Chuizheng Meng, Yihe Dong, Sercan Ö. Arik, Yan Liu, Tomas Pfister

Estimation of temporal counterfactual outcomes from observed history is crucial for decision-making in many domains such as healthcare and e-commerce, particularly when randomized controlled trials (RCTs) suffer from high cost or impracticality. For real-world datasets, modeling time-dependent confounders is challenging due to complex dynamics, long-range dependencies and both past treatments and covariates affecting the future outcomes. In this paper, we introduce Counterfactual Self-Supervised Transformer (COSTAR), a novel approach that integrates self-supervised learning for improved historical representations. We propose a component-wise contrastive loss tailored for temporal treatment outcome observations and explain its effectiveness from the view of unsupervised domain adaptation. COSTAR yields superior performance in estimation accuracy and generalization to out-of-distribution data compared to existing models, as validated by empirical results on both synthetic and real-world datasets.

📄 PDF Abstract BibTeX arXiv:2311.00886

Code (1)

google-research/google-research/tree/master/COSTAR 공식 구현 jax

Tasks

counterfactualDecision MakingDomain AdaptationSelf-Supervised LearningUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

COSTAR-A: A prompting framework for enhancing Large Language Model performance on Point-of-View questions

2025-10-14 · Nzubechukwu C. Ohalete, Kevin B. Gittner, Lauren M. Matheny arxiv

Large Language Models (LLMs) are highly sensitive to prompt design, and making optimized prompting techniques is crucial for generating consistent, high-quality outputs. In this study, we introduce COSTAR-A, a novel prom…

Prompt Engineering

COSTARR: Consolidated Open Set Technique with Attenuation for Robust Recognition

2025-08-01 · Ryan Rabinowitz, Steve Cruz, Walter Scheirer, Terrance E. Boult arxiv

Handling novelty remains a key challenge in visual recognition systems. Existing open-set recognition (OSR) methods rely on the familiarity hypothesis, detecting novelty by the absence of familiar features. We propose a …

Synergizing Deconfounding and Temporal Generalization For Time-series Counterfactual Outcome Estimation

2025-11-20 · Yiling Liu, Juncheng Dong, Chen Fu, Wei Shi 외 arxiv

Estimating counterfactual outcomes from time-series observations is crucial for effective decision-making, e.g. when to administer a life-saving treatment, yet remains significantly challenging because (i) the counterfac…

The CoSTAR Block Stacking Dataset: Learning with Workspace Constraints

2018-10-27 · Andrew Hundt, Varun Jain, Chia-Hung Lin, Chris Paxton 외

A robot can now grasp an object more effectively than ever before, but once it has the object what happens next? We show that a mild relaxation of the task and workspace constraints implicit in existing object grasping d…

6D Pose Estimation using RGBDIndustrial RobotsNeural Architecture SearchObject+4

NeBula: Quest for Robotic Autonomy in Challenging Environments; TEAM CoSTAR at the DARPA Subterranean Challenge

2021-03-21 · Ali Agha, Kyohei Otsu, Benjamin Morrell, David D. Fan 외

This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, …

Decision MakingMotion Planning