paper-with-me

홈 › Papers

Learning Weighted Representations for Generalization Across Designs

2018-02-23 · ICLR 2018 1 · Fredrik D. Johansson, Nathan Kallus, Uri Shalit, David Sontag

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from observational data and in unsupervised domain adaptation. We pose both of these problems as prediction under a shift in design. Popular methods for overcoming distributional shift make unrealistic assumptions such as having a well-specified model or knowing the policy that gave rise to the observed data. Other methods are hindered by their need for a pre-specified metric for comparing observations, or by poor asymptotic properties. We devise a bound on the generalization error under design shift, incorporating both representation learning and sample re-weighting. Based on the bound, we propose an algorithmic framework that does not require any of the above assumptions and which is asymptotically consistent. We empirically study the new framework using two synthetic datasets, and demonstrate its effectiveness compared to previous methods.

📄 PDF Abstract BibTeX arXiv:1802.08598

Code (0)

등록된 구현이 없습니다.

Tasks

Causal InferenceDomain AdaptationRepresentation LearningUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Masked Generative-Contrastive Representation Learning for Cross-Dataset EEG-Based Emotion Recognition

2026-07-05 · Huqin Weng, Jiayang Huang, Yimin Wen, Jie Du 외 arxiv

Self-supervised learning (SSL) shows strong potential for cross-dataset transfer by improving feature representation and generalization. However, its application to EEG-based emotion recognition remains largely unexplore…

Self-Supervised LearningRepresentation LearningContrastive LearningEmotion Recognition

I Have an Attention Bridge to Sell You: Generalization Capabilities of Modular Translation Architectures

2024-04-27 · Timothee Mickus, Raúl Vázquez, Joseph Attieh

Modularity is a paradigm of machine translation with the potential of bringing forth models that are large at training time and small during inference. Within this field of study, modular approaches, and in particular at…

Machine TranslationTranslation

Two-way fixed effects instrumental variable regressions in staggered DID-IV designs

2024-05-26 · Sho Miyaji

Many studies run two-way fixed effects instrumental variable (TWFEIV) regressions, leveraging variation in the timing of policy adoption across units as an instrument for treatment. This paper studies the properties of t…

Generalization Error Estimation for Primal--Dual Algorithms in Non-Smooth Regression

2026-08-14 · Kai Tan, Pierre C Bellec arxiv

This paper studies trajectory-wise estimation of generalization error for primal--dual algorithms in non-smooth regression. Motivating examples include \(\ell_1\)-penalized least absolute deviations regression and square…

Shift-Share Designs: Theory and Inference

2018-06-20 · Rodrigo Adão, Michal Kolesár, Eduardo Morales

We study inference in shift-share regression designs, such as when a regional outcome is regressed on a weighted average of sectoral shocks, using regional sector shares as weights. We conduct a placebo exercise in which…

regressionvalid